-- Logs begin at Fri 2022-06-03 12:24:45 UTC, end at Fri 2022-06-03 13:44:14 UTC. -- Jun 03 13:12:48.799152 dv-cinder-801354-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 13:12:48.808463 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 13:12:48.810398 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 13:12:48 2022] *** Jun 03 13:12:48.810398 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 13:12:48.810398 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 13:12:48.810398 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: nodename: dv-cinder-801354-5-iscsi Jun 03 13:12:48.810398 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: machine: x86_64 Jun 03 13:12:48.810398 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: clock source: unix Jun 03 13:12:48.810398 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: pcre jit disabled Jun 03 13:12:48.810398 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: detected number of CPU cores: 4 Jun 03 13:12:48.810398 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: current working directory: / Jun 03 13:12:48.810398 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: detected binary path: /usr/bin/uwsgi-core Jun 03 13:12:48.811248 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: your processes number limit is 47680 Jun 03 13:12:48.811248 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: your memory page size is 4096 bytes Jun 03 13:12:48.811248 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: detected max file descriptor number: 2048 Jun 03 13:12:48.811248 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: lock engine: pthread robust mutexes Jun 03 13:12:48.811248 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: thunder lock: enabled Jun 03 13:12:48.811248 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 13:12:48.811248 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 13:12:48.854768 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: Python main interpreter initialized at 0x55a060da89c0 Jun 03 13:12:48.854768 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: python threads support enabled Jun 03 13:12:48.854768 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: your server socket listen backlog is limited to 100 connections Jun 03 13:12:48.854768 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: your mercy for graceful operations on workers is 90 seconds Jun 03 13:12:48.855120 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 13:12:48.855208 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: *** Operational MODE: preforking *** Jun 03 13:12:48.855427 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: *** uWSGI is running in multiple interpreter mode *** Jun 03 13:12:48.855427 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: spawned uWSGI master process (pid: 103739) Jun 03 13:12:48.855609 dv-cinder-801354-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 13:12:48.860243 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: spawned uWSGI worker 1 (pid: 103740, cores: 1) Jun 03 13:12:48.860243 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: spawned uWSGI worker 2 (pid: 103741, cores: 1) Jun 03 13:12:48.860243 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 13:12:50.086804 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 13:12:50.087436 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 13:12:50.807643 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:12:50.807643 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: from cryptography.utils import int_from_bytes Jun 03 13:12:50.807922 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:12:50.807922 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: from cryptography.utils import int_from_bytes Jun 03 13:12:50.808065 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:12:50.808065 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: from cryptography.utils import int_from_bytes Jun 03 13:12:50.808258 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:12:50.808258 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: from cryptography.utils import int_from_bytes Jun 03 13:12:53.429552 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 13:12:53.430307 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 13:12:53.430307 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 13:12:53.430618 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 13:12:53.430875 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 13:12:53.431268 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.431595 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.431924 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.432012 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 13:12:53.432415 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 13:12:53.432510 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.432603 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.432763 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 13:12:53.432901 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.433129 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 13:12:53.433226 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.433388 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 13:12:53.433537 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.433779 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.433879 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.434111 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.434215 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.434427 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.434513 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.434745 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.434842 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-5-iscsi {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.435067 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.435160 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.435379 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.435472 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.435692 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.435781 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.436013 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.436105 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.436354 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.436442 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.436615 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.436706 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.436921 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.437008 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.437248 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-5-iscsi {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.437469 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.437581 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.437872 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.437988 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.438186 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.438300 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.438554 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.438694 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.438803 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.438909 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.439121 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.439220 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.439430 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.439518 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.439771 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.439944 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.440087 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.440286 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.440441 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.440601 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.440757 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.440914 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.441162 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-5-iscsi {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.441258 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.441484 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.441580 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.441802 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.441903 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.442121 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.442207 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.442460 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.442553 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.442785 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.442873 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.443098 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.443187 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.443454 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.443541 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-5-iscsi {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.443778 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.443867 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.444089 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.444195 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.444442 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.444531 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.444764 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.444858 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.445087 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.445182 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.445962 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.446068 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.446271 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.446402 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.446585 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.446732 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.446903 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.447045 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.447229 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.447378 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.447542 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.447704 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.447852 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.448028 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.448123 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.448376 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.448467 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.448686 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.448774 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.448999 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.449086 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.449312 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.449415 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.449611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.449699 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.449863 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.449966 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.450185 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.450274 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.450473 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.450559 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.450787 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.450892 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.451104 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.451190 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.451416 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.451505 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.451727 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.451822 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.451982 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.452065 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.452256 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.452356 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.452580 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.452664 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.452903 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.452980 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.453215 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.453305 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.453527 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.453603 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.453837 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.453921 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.454149 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.454232 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.454458 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.454534 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.454768 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.454851 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.455078 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.455162 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.455389 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.455464 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.455710 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.455785 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.456025 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.456119 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.456363 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.456454 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.456671 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.456758 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.456995 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.457097 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.457304 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.457397 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.457614 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.457711 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.457924 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.458013 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.458248 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.458335 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.458576 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.458664 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.458885 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.458974 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.459137 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.459224 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.459443 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.459536 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.459750 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.459839 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.460070 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.460316 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.460411 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.460525 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.460721 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.460852 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.461086 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.461851 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.461954 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.462189 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.462329 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.462500 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.462596 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.462811 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.462898 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.463119 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.463208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.463426 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.463513 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.463732 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.463821 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.464041 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.464131 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.464373 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.464463 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.464678 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.464765 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.465000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.465095 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.465309 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.465401 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.465617 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.465717 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.465926 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.466013 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.466234 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.466333 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.466541 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.466631 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.466854 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.466943 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.467162 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.467257 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.467468 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.467561 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.467788 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.467875 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.468094 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.468199 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.468427 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.468525 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.468734 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.468824 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.469043 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.469137 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.469353 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.469448 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.469670 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.469757 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.469974 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.470057 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.470283 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.470377 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.470601 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.470694 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.470907 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.470988 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.471211 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.471306 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.471517 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.471610 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.471824 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.471910 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.472131 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.472253 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.472459 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.472547 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.472764 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.472851 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.473069 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.473159 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.473372 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.473471 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.473687 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.473773 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.473998 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.474086 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.474307 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.474397 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.474616 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.474701 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.474922 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.475020 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.475229 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.475324 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.475536 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.475630 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.475843 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.475932 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.476174 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.476275 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.476486 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.476650 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.476918 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.477007 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.477233 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.477359 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.477544 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.477686 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.477855 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.478003 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.478180 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:12:53.478323 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.478519 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.478657 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.478855 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.478975 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.479201 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.479294 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.479522 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.479617 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.479904 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.479979 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.480250 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.480342 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.480589 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.480679 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.480910 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.480997 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.481231 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.481325 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.481553 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.481642 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.481868 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.481965 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.482185 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.482272 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.482753 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.482844 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.483077 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.483171 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.483390 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.483475 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.483722 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.483811 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.484043 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.484131 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.484390 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.484477 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.484713 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.484802 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.485028 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.485119 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.485352 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.485483 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.485648 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.485732 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.485955 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.486053 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.486279 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.486376 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.486620 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.486715 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.486933 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.487021 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.487254 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.487350 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.487569 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.487664 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.487885 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.487974 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.488220 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.488325 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.488537 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.488625 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.488847 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.488947 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.489172 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.489267 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.489492 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.489579 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.489812 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.489900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.490128 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.490217 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.490446 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.490532 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.490759 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.490847 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.491072 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.491161 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.491382 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.491476 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.491691 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.491778 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.491998 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.492088 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.492393 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.492493 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.492714 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.492963 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.493063 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.493281 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.493368 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.493607 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.493694 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.493941 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.494039 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.494255 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.494347 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.494564 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.494658 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.494869 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.494955 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.495176 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.495287 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.495502 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.495597 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.495793 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.495881 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.496098 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.496253 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.496438 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.496526 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.496756 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.496855 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.497063 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.497158 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.497388 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.497477 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.497700 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.497795 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.498007 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.498102 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.498333 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.498428 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.498640 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.498727 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.498949 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.499036 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.499259 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.499355 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.499568 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.499656 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.499878 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.499964 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.500219 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.500322 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.500536 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.500623 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.500860 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.500947 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.501169 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.501276 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.501532 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.501633 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.501805 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.501893 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.502121 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.502217 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.502430 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.502517 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.502740 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.502828 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.503052 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.503143 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.503375 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.503462 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.503685 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.503772 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.503996 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.504085 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.504330 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.504420 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.504642 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.504733 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.504953 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.505083 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.505267 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.505357 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.505733 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.505860 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.505988 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.506074 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.506161 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.506241 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.506456 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.506599 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.506768 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.506846 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.507093 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.507182 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.507404 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.507506 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.507741 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.508344 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.508613 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.508802 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.509065 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.509149 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.509285 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.509452 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.509580 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.509767 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.509866 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.510115 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.510212 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.510453 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.510541 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.510760 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.510859 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.511088 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.511182 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.511398 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.511484 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.511713 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.511813 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.512030 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.512119 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.512372 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.512462 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.512688 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.512789 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.513005 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.513094 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.513328 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.513417 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.513643 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.513733 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.513959 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.514046 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.514272 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.514359 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.514586 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.514682 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.514900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.514986 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.515213 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.515301 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.515519 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.515609 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.515835 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.515923 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.516189 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.516281 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.516494 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.516588 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.516820 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.516911 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.517136 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.517224 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.517454 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.517550 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.517763 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.517849 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.518074 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.518170 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.518390 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.518485 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.518705 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.518793 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.519022 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.519119 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.519344 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.519439 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.519656 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.519742 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.519973 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.520069 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.520307 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.520411 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.520620 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.520756 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.520936 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.521034 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.521252 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.521340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.521558 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.521652 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.521874 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.521972 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.522195 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.522282 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.522508 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.522596 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.522830 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.522925 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.523142 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.523229 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.523546 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.524328 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.524437 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.524510 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.524702 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.524791 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.525032 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.525160 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.525370 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.525459 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.525683 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.525770 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.525997 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.526093 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.526315 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.526410 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.526628 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.526714 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.526940 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.527077 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.527253 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.527348 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.527564 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.527660 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.527874 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.527969 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.528206 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.528298 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.528518 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.528609 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.528832 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.528934 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.529147 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.529243 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.529459 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.529545 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.529775 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.529870 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.530088 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.530176 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.530394 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.530489 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.530701 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.530827 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.531017 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.531108 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.531327 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.531413 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.531635 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.531725 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.531946 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.532035 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.532277 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.532370 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.532596 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.532685 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.532904 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.532992 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.533216 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.533304 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.533534 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.533622 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.533846 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.533933 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.534156 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.534265 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.534467 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.534564 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.534776 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.534863 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.535089 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.535186 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.535406 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.535500 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.535718 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.535805 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.536027 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.536128 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.536363 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.536450 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.536674 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.536771 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.536985 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.537081 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.537298 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.537387 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.537620 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.537713 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.537931 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.538028 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.538241 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.538329 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.538553 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.538639 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.538859 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.538956 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.539192 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.539286 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.539551 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.539762 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.539853 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.540096 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.540205 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.540456 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.540546 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.540771 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.540886 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.541081 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.541169 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.541395 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.541494 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.541714 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.541812 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.542043 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.542285 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.542375 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.542622 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.542720 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.542985 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.543154 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.543319 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.543404 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.543633 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.543731 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.543941 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.544031 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.544278 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.544384 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.544591 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.544678 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.544897 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.544988 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.545204 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.545316 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.545519 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.545607 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.545824 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.545929 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.546128 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.546219 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.546434 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.546524 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.546740 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.546838 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.547047 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.547136 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.547355 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.547442 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.547667 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.547764 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.547969 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.548058 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.548296 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.548606 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.548709 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.548911 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.548999 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.549217 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.549308 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.549521 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.549610 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.549835 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.549934 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.550148 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.550239 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.550469 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.550558 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.550782 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.550873 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.551127 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.551222 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.551388 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.551478 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.551700 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.551791 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.552027 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.552125 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.552359 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.552457 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.552669 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.552763 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.552977 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.553085 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.553289 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.553391 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.553599 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.553693 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.553904 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.554008 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.554219 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.554313 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.554531 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.554625 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.554871 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.555078 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.555159 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.555237 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.555475 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.555583 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.555777 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.555877 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.556084 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.556211 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.556424 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.556531 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.556731 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.556824 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.557040 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.557126 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.557385 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.557484 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.557645 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.557731 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.557951 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.558037 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.558254 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.558348 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.558564 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.558649 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.558871 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.558958 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.559175 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.559268 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.559482 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.559569 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.559786 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.559879 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.560093 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.560211 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.560420 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.560526 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.560735 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.560830 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.561037 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.561131 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.561354 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.561444 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.561660 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.561746 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.561966 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.562052 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.562271 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.562356 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.562581 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.562665 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.562888 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.562975 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.563190 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.563274 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.563499 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.563582 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.563813 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.563898 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.564120 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.564222 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.564448 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.564537 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.564758 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.564852 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.565061 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.565148 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.565367 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.565505 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.565669 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.565756 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.565997 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.566091 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.566281 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.566378 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.566585 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.566673 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.566890 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.566977 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.567195 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.567294 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.567492 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.567627 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.567796 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.567920 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.568106 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.568293 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.568418 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.568541 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.568730 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.568855 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.569058 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.569182 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.569327 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.569450 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.569632 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.569766 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.569962 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.570088 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.570839 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.570974 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.571200 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.571412 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.571546 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.571680 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.571805 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.571933 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.572119 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.572280 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.572460 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.572592 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.572767 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.572894 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.573083 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.573215 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.573396 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.573522 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.573709 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.573841 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.574013 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.574151 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.574318 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.574443 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.574640 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.574765 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.574946 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.575083 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.575255 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.575389 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.575565 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.575688 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.575952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.576097 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.576260 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.576394 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.576518 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.576640 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.576811 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.576944 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.577120 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.577243 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.577432 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.577631 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.577767 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.577889 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.578036 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.578171 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.578348 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.578473 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.578661 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.578787 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.578967 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.579090 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.579278 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.579411 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.579588 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.579713 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.579894 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.580017 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.580221 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.580349 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.580533 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.580657 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.580840 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.581041 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.581165 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.581295 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.581493 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.581627 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.581750 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.581871 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.582039 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.582173 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.582343 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.582466 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.582650 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.582773 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.582952 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.583083 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.583274 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.583398 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.583585 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.583708 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.583893 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.584026 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.584226 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.584353 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.584534 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.584658 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.584848 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.584974 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.585154 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.585278 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.585590 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.585713 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.585844 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.586611 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.586743 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.586895 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.587208 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.587342 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.587539 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.587679 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.587862 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.587986 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.588169 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.588295 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.588487 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.588614 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.588799 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.588933 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.589124 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.589259 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.589435 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.589560 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.589743 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.589868 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.590053 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.590185 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.590380 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.590506 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.590690 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.590815 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.591050 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.591193 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.591341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.591544 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.591678 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.591791 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.591946 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.592080 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.592291 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.592467 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.592605 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.592783 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.592916 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.593097 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.593222 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.593423 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.593637 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.593762 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.593953 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.594086 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.594263 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.594388 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.594666 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.594789 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.594979 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.595104 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.595291 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.595422 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.595620 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.595761 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.595935 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.596066 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.596277 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.596405 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.596588 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.596786 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.596911 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.597042 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.597204 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.597338 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.597532 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.597658 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.598075 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.598228 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.598228 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.598462 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.598586 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.598708 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.598830 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.598964 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.599089 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.599211 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.599388 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.599516 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.599706 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.599840 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.600032 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.600186 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.600442 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.600565 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.600754 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.600897 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.601066 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.601346 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.601475 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.601698 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.601961 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.602098 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.602279 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.602415 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.602539 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.602668 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.602805 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.602936 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.603059 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.603188 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.603351 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.603477 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.603678 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.603805 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.603987 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.604119 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.604328 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.604457 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.604644 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.604782 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.604956 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.605089 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.605264 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.605403 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.605574 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.605700 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.605900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.606025 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.606209 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.606343 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.606537 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.606663 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.606872 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.607001 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.607161 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.607295 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.607776 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.607904 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.608115 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.608265 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.608428 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.608565 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.608762 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.608900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.609087 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.609215 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.609388 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.609523 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.609699 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.609824 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.610035 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.610158 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.610357 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.610488 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.610658 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.610791 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.610983 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.611108 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.611324 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.611485 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.611609 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.611733 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.611888 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.612089 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.612287 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.612413 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.612535 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.612656 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.612808 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.612950 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.613119 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.613245 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.613424 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.613549 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.613731 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.613866 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.614036 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.614161 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.614359 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.614484 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.614665 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.614801 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.614988 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.615122 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.615299 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.615424 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.615604 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.615737 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.615912 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.616035 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.616238 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.616365 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.616563 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.616690 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.616869 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.617082 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.617717 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.617865 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.618050 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.618253 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.618380 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.618509 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.618633 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.618755 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.618909 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.619066 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.619253 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.619378 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.619562 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.619688 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.619898 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.620032 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.620241 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.620408 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.620568 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.620732 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.620901 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.621055 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.621212 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.621439 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.621574 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.621707 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.621830 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.621990 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.622137 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.622323 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.622448 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.622613 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.622740 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.622934 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.623060 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.623359 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.623485 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.623678 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.623806 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.623992 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.624118 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.624336 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.624475 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.624654 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.624780 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.624975 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.625101 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.625333 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.625502 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.625650 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.625831 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.625964 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.626150 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.626276 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.626465 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.626593 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.626780 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.626906 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.627115 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.627259 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.627393 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.627517 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.627703 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.627830 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.628015 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.628181 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.628380 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.628519 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.628651 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.628775 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.628972 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.629112 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.629299 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.629426 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.629628 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.629755 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.629965 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.630092 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.630285 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.630413 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.630610 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.630764 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.630972 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.631107 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.631250 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.631380 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.631581 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.631723 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.631862 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.631986 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.632197 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.632340 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.632526 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.632670 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.633435 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.633599 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.633788 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.633913 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.634105 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.634276 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.634424 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.634612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.634739 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.634955 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.635089 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.635282 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.635408 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.635604 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.635730 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.635925 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.636060 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.636271 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.636398 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.636597 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.636798 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.636926 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.637120 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.637322 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.637448 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.637580 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.637779 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.637913 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.638115 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.638240 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.638450 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.638662 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.638789 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.638981 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.639339 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.639473 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.639597 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.639719 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.639841 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.639974 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.640097 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.640304 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.640442 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.640633 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.640760 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.640960 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.641094 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.641260 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.641388 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.641571 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.641783 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.641910 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.642040 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.642165 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.642287 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.642476 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.642728 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.642858 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.643084 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.643209 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.643392 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.643514 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.643712 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.643837 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.644024 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.644203 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.644374 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.644588 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.644736 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.644939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.645073 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.645260 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.645393 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.645588 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.645713 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.645907 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.646032 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.646223 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.646360 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.646532 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.646657 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.646837 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.646961 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.647148 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.647274 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.647481 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.647607 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.647754 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.647878 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.648067 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.648209 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.648427 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.648630 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.648756 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.648965 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.649091 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.649350 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.649483 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.649658 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.649784 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.649967 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.650091 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.650271 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.650403 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.650581 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.650707 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.650892 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.651024 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.651198 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.651323 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.651503 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.651627 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.651826 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.651964 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.652118 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.652272 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.652445 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.652578 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.652776 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.652920 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.653044 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.653166 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.653350 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.653477 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.653657 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.653793 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.653968 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.654095 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.654276 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.654401 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.654588 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.654723 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.654895 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.655021 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.655206 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.655332 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.655518 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.655662 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.655843 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.655969 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.656191 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.656321 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.656482 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.656607 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.656801 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.656934 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.657113 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.657239 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.657436 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.657659 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.657790 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.658003 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.658135 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.658329 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.658463 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.658672 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.658807 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.658995 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.659209 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.659336 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.659548 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.659676 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.659872 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.659999 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.660231 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.660374 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.660547 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.660673 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.660862 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.660989 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.661172 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.661305 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.661482 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.661608 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.661792 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.661935 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.662130 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.662269 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.662393 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.662523 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.662698 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.662844 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.663036 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.663165 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.663309 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.663434 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.663616 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.663740 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.663925 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.664092 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.664329 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.664490 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.664627 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.664751 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.664907 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.665035 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.665218 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.665356 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.665522 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.665662 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.665823 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.665950 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.666140 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.666266 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.666483 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.666617 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.666794 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.666918 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.667108 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.667235 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.667421 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.667554 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.667760 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.667886 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.668040 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.668189 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.668377 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.668516 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.668689 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.668898 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.669030 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.669152 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.669305 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.669432 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.669635 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.669763 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.669952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.670085 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.670283 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.670424 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.670639 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.670764 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.670965 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.671098 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.671280 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.671407 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.671916 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.672048 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.672311 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.672448 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.672574 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.672696 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.672818 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.672940 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.673134 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.673269 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.673392 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.673523 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.673646 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.673768 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.673891 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.674022 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.674146 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.674274 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.674397 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.674519 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.674707 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.674842 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.675020 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.675147 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.675327 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.675452 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.675633 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.675760 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.675943 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.676074 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.676275 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.676403 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.676586 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.676715 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.676891 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.677022 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.677195 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.677328 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.677503 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.677628 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.677831 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.677967 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.678090 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.678220 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.678395 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.678522 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.678698 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.678903 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.679032 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.679162 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.679286 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.679408 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.679636 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.680298 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.680444 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.680587 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.680757 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.680884 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.681065 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.681199 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.681372 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.681507 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.681677 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.681803 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.682007 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.682131 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.682340 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.682475 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.682620 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.682746 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.682927 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.683054 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.683262 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.683390 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.683554 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.683680 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.683865 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.683991 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.684211 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.684353 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.684535 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.684662 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.684849 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.684986 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.685159 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.685283 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.685489 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.685612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.685791 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.685924 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.686106 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.686233 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.686419 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.686544 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.686729 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.686866 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.687041 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.687166 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.687356 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.687481 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.687667 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.687803 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.688011 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.688138 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.688311 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.688450 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.688624 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.688752 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.688981 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.689117 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.689263 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.689394 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.689580 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.689704 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.689885 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.690016 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.690214 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.690339 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.690528 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.690653 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.690840 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.690964 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.691158 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.691291 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.691471 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.691601 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.691783 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.691912 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.692102 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.692286 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.692425 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.692610 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.692735 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.692858 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.693043 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.693178 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.693373 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.693508 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.693663 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.693788 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.693979 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.694106 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.694308 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.694442 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.694639 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.694772 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.694951 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.695078 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.695319 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.696026 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.696174 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.696381 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.696524 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.696737 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.696864 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.696993 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 13:12:53.697115 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.697392 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.697726 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.698047 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.698359 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.698668 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:12:53.698913 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 13:12:53.755748 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO dbcounter [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] Registered counter for database nova_api Jun 03 13:12:53.757654 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO dbcounter [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Registered counter for database nova_api Jun 03 13:12:53.778098 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG oslo_db.sqlalchemy.engines [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:12:53.779561 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_db.sqlalchemy.engines [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:12:53.786881 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writer thread running {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:12:53.791159 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG dbcounter [-] [103740] Writer thread running {{(pid=103740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:12:53.843599 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.context [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49069df2-a830-4b3d-8fbf-b69025d043f4(cell1) {{(pid=103741) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 13:12:53.847742 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:53.849363 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:53.850171 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:53.852175 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:53.854149 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO dbcounter [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Registered counter for database nova_cell0 Jun 03 13:12:53.858426 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO dbcounter [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Registered counter for database nova_cell1 Jun 03 13:12:53.866193 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.context [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49069df2-a830-4b3d-8fbf-b69025d043f4(cell1) {{(pid=103740) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 13:12:53.866373 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_db.sqlalchemy.engines [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:12:53.868136 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_db.sqlalchemy.engines [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:12:53.871456 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG oslo_concurrency.lockutils [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:53.873076 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG oslo_concurrency.lockutils [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:53.873876 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG oslo_concurrency.lockutils [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:53.874544 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writer thread running {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:12:53.875818 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG oslo_concurrency.lockutils [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:53.876560 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writer thread running {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:12:53.877835 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO dbcounter [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] Registered counter for database nova_cell0 Jun 03 13:12:53.881841 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO dbcounter [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] Registered counter for database nova_cell1 Jun 03 13:12:53.889141 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG oslo_db.sqlalchemy.engines [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:12:53.891213 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG oslo_db.sqlalchemy.engines [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:12:53.896724 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG dbcounter [-] [103740] Writer thread running {{(pid=103740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:12:53.897983 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG dbcounter [-] [103740] Writer thread running {{(pid=103740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:12:54.026334 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO dbcounter [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Registered counter for database nova_cell0 Jun 03 13:12:54.034885 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_db.sqlalchemy.engines [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:12:54.039222 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writer thread running {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:12:54.045527 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO dbcounter [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] Registered counter for database nova_cell0 Jun 03 13:12:54.054085 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG oslo_db.sqlalchemy.engines [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:12:54.058527 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG dbcounter [-] [103740] Writer thread running {{(pid=103740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:12:54.573635 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: WARNING keystonemiddleware.auth_token [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 13:12:54.580973 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: WARNING keystonemiddleware.auth_token [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 13:12:54.587791 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: WARNING keystonemiddleware.auth_token [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 13:12:54.595121 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: WARNING keystonemiddleware.auth_token [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 13:12:54.809258 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: WARNING keystonemiddleware.auth_token [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 13:12:54.815234 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: WARNING keystonemiddleware.auth_token [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 13:12:54.820605 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a060da89c0 pid: 103741 (default app) Jun 03 13:12:54.821587 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: WARNING keystonemiddleware.auth_token [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 13:12:54.822929 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:54.824192 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001983 Jun 03 13:12:54.824552 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Fri Jun 3 13:12:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:12:54.827687 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: WARNING keystonemiddleware.auth_token [None req-d37bf8b7-f45b-46c7-be95-21af0147d260 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 13:12:54.832856 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a060da89c0 pid: 103740 (default app) Jun 03 13:14:17.382650 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:17.384387 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 Jun 03 13:14:17.390032 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:14:17 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:17.397340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG dbcounter [-] [103740] Writing DB stats nova_api:SELECT=3 {{(pid=103740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:17.399401 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG dbcounter [-] [103740] Writing DB stats nova_cell1:SELECT=3 {{(pid=103740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:17.400767 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG dbcounter [-] [103740] Writing DB stats nova_cell0:SELECT=3 {{(pid=103740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:17.402301 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG dbcounter [-] [103740] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:17.849522 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-699b4ac7-2370-4c64-9a47-b14c69c6c8ed admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:17.881642 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-699b4ac7-2370-4c64-9a47-b14c69c6c8ed admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.489374 Jun 03 13:14:17.882428 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1291 bytes} [Fri Jun 3 13:14:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:14:20.205125 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:20.206103 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-30c0ef5a-4498-4ac1-9fce-61b01f5a2ed7 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 03 13:14:20.206713 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:14:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:20.270117 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-c1a451bd-b8c4-4c6d-a7dc-f60d9ad45340 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:20.288981 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:14:20.288981 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: warnings.warn(msg) Jun 03 13:14:20.376914 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-c1a451bd-b8c4-4c6d-a7dc-f60d9ad45340 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.163743 Jun 03 13:14:20.377665 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 13:14:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:14:20.390671 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_api:SELECT=3 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:20.391632 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_cell1:SELECT=3 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:20.392387 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_cell0:SELECT=3 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:20.393294 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:20.599403 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-28f59afe-5dba-413f-95bf-36dd835dff6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:20.602456 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:14:20.602456 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: warnings.warn(msg) Jun 03 13:14:20.740740 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-28f59afe-5dba-413f-95bf-36dd835dff6d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.355100 Jun 03 13:14:20.741550 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jun 3 13:14:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:23.190956 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-c1a451bd-b8c4-4c6d-a7dc-f60d9ad45340 admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:23.192109 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-c1a451bd-b8c4-4c6d-a7dc-f60d9ad45340 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 03 13:14:23.192485 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:14:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:23.306527 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-bb3195b6-2800-49c2-bb0b-4374e4db4a94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1", "vcpus": 1, "name": "ds512M", "disk": 5, "ram": 512, "rxtx_factor": 1.0}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:23.324615 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:14:23.324615 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: warnings.warn(msg) Jun 03 13:14:23.406154 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-bb3195b6-2800-49c2-bb0b-4374e4db4a94 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.203433 Jun 03 13:14:23.406154 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 13:14:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:14:23.425378 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-33a3fb22-4af9-4659-b9fc-1c8e0a7565a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:23.426878 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:14:23.426878 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: warnings.warn(msg) Jun 03 13:14:23.544479 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-33a3fb22-4af9-4659-b9fc-1c8e0a7565a2 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123872 Jun 03 13:14:23.545782 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jun 3 13:14:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:25.869093 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-bb3195b6-2800-49c2-bb0b-4374e4db4a94 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:25.870117 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-bb3195b6-2800-49c2-bb0b-4374e4db4a94 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001728 Jun 03 13:14:25.870946 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:14:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:25.931487 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-7edb6c90-ad4e-4fb3-85f5-c1a62be2c9bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "disk": 10}} {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:26.011217 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-7edb6c90-ad4e-4fb3-85f5-c1a62be2c9bd admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134872 Jun 03 13:14:26.011953 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 13:14:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:14:26.024427 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-d44a09ed-4e8d-4a60-8aad-e999841c2770 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:26.086004 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-d44a09ed-4e8d-4a60-8aad-e999841c2770 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.065385 Jun 03 13:14:26.086983 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jun 3 13:14:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:28.417368 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-7edb6c90-ad4e-4fb3-85f5-c1a62be2c9bd admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:28.418438 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-7edb6c90-ad4e-4fb3-85f5-c1a62be2c9bd admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jun 03 13:14:28.418847 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:14:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:28.482362 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-2ec1a5a4-26a1-4f60-9145-1daa789e0ecc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "name": "ds2G"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:28.562832 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-2ec1a5a4-26a1-4f60-9145-1daa789e0ecc admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137469 Jun 03 13:14:28.563308 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 13:14:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:14:28.576652 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-33fe7070-3692-497a-b559-69c116d9128a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:28.657345 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-33fe7070-3692-497a-b559-69c116d9128a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084822 Jun 03 13:14:28.657938 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jun 3 13:14:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:14:30.982443 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-2ec1a5a4-26a1-4f60-9145-1daa789e0ecc admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:30.983446 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-2ec1a5a4-26a1-4f60-9145-1daa789e0ecc admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 03 13:14:30.983849 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:14:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:31.046502 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-e95346d9-e844-4f6b-9ad2-6a3f2197b41f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096}} {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:31.120093 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-e95346d9-e844-4f6b-9ad2-6a3f2197b41f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.129812 Jun 03 13:14:31.120992 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 13:14:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:14:31.132524 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-cab5ee42-666c-41e6-8031-c19986a689af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:31.423326 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-cab5ee42-666c-41e6-8031-c19986a689af admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294469 Jun 03 13:14:31.424139 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jun 3 13:14:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:14:33.784467 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-e95346d9-e844-4f6b-9ad2-6a3f2197b41f admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:33.785484 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-e95346d9-e844-4f6b-9ad2-6a3f2197b41f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 03 13:14:33.785885 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:14:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:33.846767 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-7d3412f9-d4c8-4082-bdb9-6a507d2bbe5f admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:33.872627 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-7d3412f9-d4c8-4082-bdb9-6a507d2bbe5f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080319 Jun 03 13:14:33.873260 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1291 bytes} [Fri Jun 3 13:14:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:36.188486 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-e95346d9-e844-4f6b-9ad2-6a3f2197b41f admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:36.189849 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-e95346d9-e844-4f6b-9ad2-6a3f2197b41f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Jun 03 13:14:36.190398 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:14:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:36.255368 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-4c587e2f-404a-4622-af67-7f9827ecb9d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "ram": 512, "name": "m1.tiny", "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:36.339241 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-4c587e2f-404a-4622-af67-7f9827ecb9d8 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.140354 Jun 03 13:14:36.340320 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 13:14:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:14:36.353197 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-179369eb-c22c-4721-bca5-06d02d60d680 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:36.454644 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-179369eb-c22c-4721-bca5-06d02d60d680 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105462 Jun 03 13:14:36.455250 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jun 3 13:14:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:14:38.892282 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-4c587e2f-404a-4622-af67-7f9827ecb9d8 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:38.893381 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-4c587e2f-404a-4622-af67-7f9827ecb9d8 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jun 03 13:14:38.893807 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:14:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:38.970460 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-1b24016f-bece-4d6c-9c7b-ac7b47a764d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "2"}} {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:39.063574 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-1b24016f-bece-4d6c-9c7b-ac7b47a764d0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.163400 Jun 03 13:14:39.064434 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 13:14:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:14:39.080443 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-45239d4e-7918-47fd-8abe-59e2b05b1296 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:39.185735 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-45239d4e-7918-47fd-8abe-59e2b05b1296 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109244 Jun 03 13:14:39.186458 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jun 3 13:14:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:41.610901 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-1b24016f-bece-4d6c-9c7b-ac7b47a764d0 admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:41.611926 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-1b24016f-bece-4d6c-9c7b-ac7b47a764d0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 03 13:14:41.612399 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:14:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:41.670394 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-284d2c3d-3568-41cf-be5f-28dfb9678ba6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "ram": 4096}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:41.764927 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-284d2c3d-3568-41cf-be5f-28dfb9678ba6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.145851 Jun 03 13:14:41.765480 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 13:14:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:14:41.777770 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-09b25838-30d2-4c44-bedd-a963dc5a6644 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:41.882495 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-09b25838-30d2-4c44-bedd-a963dc5a6644 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108347 Jun 03 13:14:41.883033 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jun 3 13:14:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:14:44.204323 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-284d2c3d-3568-41cf-be5f-28dfb9678ba6 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:44.205329 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-284d2c3d-3568-41cf-be5f-28dfb9678ba6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 03 13:14:44.205725 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:14:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:44.263996 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-605ced66-d418-4312-89ad-ca127af42138 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "id": "4", "disk": 80, "name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:44.373358 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-605ced66-d418-4312-89ad-ca127af42138 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.162058 Jun 03 13:14:44.373904 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 13:14:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:14:44.385702 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-11ffe797-6b37-417f-af1c-3fc39d92cb7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:44.452717 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-11ffe797-6b37-417f-af1c-3fc39d92cb7d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070635 Jun 03 13:14:44.453351 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jun 3 13:14:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:46.809252 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-605ced66-d418-4312-89ad-ca127af42138 admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:46.810561 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-605ced66-d418-4312-89ad-ca127af42138 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001751 Jun 03 13:14:46.811032 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:14:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:46.874651 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-3bfe6a17-5571-4fde-a99a-da02a27e46b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "name": "m1.xlarge"}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:46.954377 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-3bfe6a17-5571-4fde-a99a-da02a27e46b6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.137130 Jun 03 13:14:46.954931 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 13:14:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:14:46.968195 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-4815f257-2342-48c6-bec9-0deb3e4f1788 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:47.109013 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-4815f257-2342-48c6-bec9-0deb3e4f1788 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144616 Jun 03 13:14:47.126806 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jun 3 13:14:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:15:11.697439 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-3bfe6a17-5571-4fde-a99a-da02a27e46b6 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:11.698445 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-3bfe6a17-5571-4fde-a99a-da02a27e46b6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 03 13:15:11.698859 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:15:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:15:11.709152 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG dbcounter [-] [103740] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:15:11.757792 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-941bf869-9d4e-4b95-9b93-64f13eea4412 admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:11.776487 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-941bf869-9d4e-4b95-9b93-64f13eea4412 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071756 Jun 03 13:15:11.777024 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1291 bytes} [Fri Jun 3 13:15:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:12.780359 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-3bfe6a17-5571-4fde-a99a-da02a27e46b6 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:12.781364 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-3bfe6a17-5571-4fde-a99a-da02a27e46b6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 03 13:15:12.781759 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 13:15:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:15:12.995068 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-587b51dd-c3cc-4da6-9b25-b6e7cb2eee03 admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:13.001004 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.wsgi [None req-587b51dd-c3cc-4da6-9b25-b6e7cb2eee03 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-587b51dd-c3cc-4da6-9b25-b6e7cb2eee03 admin admin] Request method failure captured: Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Accept: application/json Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Accept-Encoding: gzip, deflate Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Connection: keep-alive Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Content-Length: 0 Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Host: 10.222.0.61 Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Openstack-Api-Version: compute 2.90 Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Openstack-System-Scope: None Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: User-Agent: python-novaclient Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Auth-Token: gAAAAABimglg1rV87t_21cyK_6Am7FlgLrWtBtbK7MZ8LLGh2gRLcSYltTDQv72VGxkFkwJCepMbY9L6WY5NWV-wbTVFCdsXA06fxYMy3dUcyriXgf5FZ1Qcux4GAry8xI4actQkAN_M7ys8aoUO_D7Xu5OJYCEge_EiuYZYW3ewj5xHP5j4IP4 Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Domain-Id: None Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Domain-Name: None Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Identity-Status: Confirmed Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Is-Admin-Project: True Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Project-Domain-Id: default Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Project-Domain-Name: Default Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Project-Id: ade16b49bacd4a0789895b9341a45a4d Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Project-Name: admin Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Role: reader,admin,member Jun 03 13:15:13.004340 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Roles: reader,admin,member Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade16b49bacd4a0789895b9341a45a4d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Tenant: admin Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Tenant-Id: ade16b49bacd4a0789895b9341a45a4d Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Tenant-Name: admin Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User: admin Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User-Domain-Id: default Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User-Domain-Name: Default Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User-Id: 31e8e6595d7242a98c3388e4c3784e70 Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User-Name: admin Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: method: > Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: exception: Flavor 42 could not be found. Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: action_args: {'id': '42'} Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:15:13.006057 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:15:13.007887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:13.014175 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-587b51dd-c3cc-4da6-9b25-b6e7cb2eee03 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:15:13.015504 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-587b51dd-c3cc-4da6-9b25-b6e7cb2eee03 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.068534 Jun 03 13:15:13.015504 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Jun 3 13:15:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:13.016259 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-545c3cba-74ab-4def-9c0d-4ecbb8881945 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:13.019223 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:15:13.037948 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-545c3cba-74ab-4def-9c0d-4ecbb8881945 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025269 Jun 03 13:15:13.041548 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jun 3 13:15:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:13.062887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-ba249a64-56bd-4022-942b-ea9fece43faa admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:13.084884 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-ba249a64-56bd-4022-942b-ea9fece43faa admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025912 Jun 03 13:15:13.085589 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jun 3 13:15:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:13.101460 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-ffa06549-4132-482d-bbfd-45fdcc298ca9 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:13.107497 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.wsgi [None req-ffa06549-4132-482d-bbfd-45fdcc298ca9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-ffa06549-4132-482d-bbfd-45fdcc298ca9 admin admin] Request method failure captured: Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Accept: application/json Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Accept-Encoding: gzip, deflate Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Connection: keep-alive Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Content-Length: 0 Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Host: 10.222.0.61 Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Openstack-Api-Version: compute 2.90 Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Openstack-System-Scope: None Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: User-Agent: python-novaclient Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Auth-Token: gAAAAABimglg1rV87t_21cyK_6Am7FlgLrWtBtbK7MZ8LLGh2gRLcSYltTDQv72VGxkFkwJCepMbY9L6WY5NWV-wbTVFCdsXA06fxYMy3dUcyriXgf5FZ1Qcux4GAry8xI4actQkAN_M7ys8aoUO_D7Xu5OJYCEge_EiuYZYW3ewj5xHP5j4IP4 Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Domain-Id: None Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Domain-Name: None Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Identity-Status: Confirmed Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Is-Admin-Project: True Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Project-Domain-Id: default Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Project-Domain-Name: Default Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Project-Id: ade16b49bacd4a0789895b9341a45a4d Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Project-Name: admin Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Role: reader,admin,member Jun 03 13:15:13.111144 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Roles: reader,admin,member Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade16b49bacd4a0789895b9341a45a4d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Tenant: admin Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Tenant-Id: ade16b49bacd4a0789895b9341a45a4d Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Tenant-Name: admin Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User: admin Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User-Domain-Id: default Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User-Domain-Name: Default Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User-Id: 31e8e6595d7242a98c3388e4c3784e70 Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User-Name: admin Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: method: > Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: exception: Flavor 42 could not be found. Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: action_args: {'id': '42'} Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:15:13.112900 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:15:13.113952 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:13.115293 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-ffa06549-4132-482d-bbfd-45fdcc298ca9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:15:13.122560 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-ffa06549-4132-482d-bbfd-45fdcc298ca9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014845 Jun 03 13:15:13.122560 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Jun 3 13:15:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:13.984248 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-ba249a64-56bd-4022-942b-ea9fece43faa admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:13.985512 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-ba249a64-56bd-4022-942b-ea9fece43faa admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Jun 03 13:15:13.985908 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 13:15:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:15:14.180605 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-62d6fa4f-eddc-4ea7-a94d-6a671029daed admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:14.185812 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.wsgi [None req-62d6fa4f-eddc-4ea7-a94d-6a671029daed admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-62d6fa4f-eddc-4ea7-a94d-6a671029daed admin admin] Request method failure captured: Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Accept: application/json Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Accept-Encoding: gzip, deflate Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Connection: keep-alive Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Content-Length: 0 Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Host: 10.222.0.61 Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Openstack-Api-Version: compute 2.90 Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Openstack-System-Scope: None Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: User-Agent: python-novaclient Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Auth-Token: gAAAAABimglhXZ_1pWRC4MBU2O1C0lrc24hrtdqvR2XVIIUaEekB51W04di01C5ljoqGUfB2idEBvyQ9ItaRjJawEvvpfFxHr3VIbhaVA4FojklvJXXIThneqLyRxUvkTnjkaNL9clu2Mm_QfS0zpJb29BJnXTwKBykdXVdr96N5pIDEeuN7K_o Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Domain-Id: None Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Domain-Name: None Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Identity-Status: Confirmed Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Is-Admin-Project: True Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Project-Domain-Id: default Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Project-Domain-Name: Default Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Project-Id: ade16b49bacd4a0789895b9341a45a4d Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Project-Name: admin Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Role: reader,admin,member Jun 03 13:15:14.187341 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Roles: reader,admin,member Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade16b49bacd4a0789895b9341a45a4d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Tenant: admin Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Tenant-Id: ade16b49bacd4a0789895b9341a45a4d Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Tenant-Name: admin Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User: admin Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User-Domain-Id: default Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User-Domain-Name: Default Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User-Id: 31e8e6595d7242a98c3388e4c3784e70 Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User-Name: admin Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: method: > Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: exception: Flavor 84 could not be found. Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: action_args: {'id': '84'} Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:15:14.188902 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:15:14.189939 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:14.191018 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-62d6fa4f-eddc-4ea7-a94d-6a671029daed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:15:14.192096 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-62d6fa4f-eddc-4ea7-a94d-6a671029daed admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061675 Jun 03 13:15:14.192096 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Jun 3 13:15:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:14.199906 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-ebb2054a-383c-4ff2-abf1-a9d3a121cecc admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:14.214468 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-ebb2054a-383c-4ff2-abf1-a9d3a121cecc admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018805 Jun 03 13:15:14.214998 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jun 3 13:15:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:14.224408 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-73045e47-3cfb-470d-9391-385d8c9e7b43 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:14.238665 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-73045e47-3cfb-470d-9391-385d8c9e7b43 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017807 Jun 03 13:15:14.239184 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jun 3 13:15:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:14.248633 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-a335a5f2-1e48-469c-b174-d2739b82fe81 admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:14.253791 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.wsgi [None req-a335a5f2-1e48-469c-b174-d2739b82fe81 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-a335a5f2-1e48-469c-b174-d2739b82fe81 admin admin] Request method failure captured: Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Accept: application/json Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Accept-Encoding: gzip, deflate Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Connection: keep-alive Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Content-Length: 0 Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Host: 10.222.0.61 Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Openstack-Api-Version: compute 2.90 Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Openstack-System-Scope: None Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: User-Agent: python-novaclient Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Auth-Token: gAAAAABimglhXZ_1pWRC4MBU2O1C0lrc24hrtdqvR2XVIIUaEekB51W04di01C5ljoqGUfB2idEBvyQ9ItaRjJawEvvpfFxHr3VIbhaVA4FojklvJXXIThneqLyRxUvkTnjkaNL9clu2Mm_QfS0zpJb29BJnXTwKBykdXVdr96N5pIDEeuN7K_o Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Domain-Id: None Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Domain-Name: None Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Identity-Status: Confirmed Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Is-Admin-Project: True Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Project-Domain-Id: default Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Project-Domain-Name: Default Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Project-Id: ade16b49bacd4a0789895b9341a45a4d Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Project-Name: admin Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Role: reader,admin,member Jun 03 13:15:14.255273 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Roles: reader,admin,member Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade16b49bacd4a0789895b9341a45a4d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Tenant: admin Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Tenant-Id: ade16b49bacd4a0789895b9341a45a4d Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Tenant-Name: admin Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User: admin Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User-Domain-Id: default Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User-Domain-Name: Default Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User-Id: 31e8e6595d7242a98c3388e4c3784e70 Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User-Name: admin Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: method: > Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: exception: Flavor 84 could not be found. Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: action_args: {'id': '84'} Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:15:14.256796 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:15:14.258612 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:14.259900 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-a335a5f2-1e48-469c-b174-d2739b82fe81 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:15:14.261267 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-a335a5f2-1e48-469c-b174-d2739b82fe81 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011454 Jun 03 13:15:14.261267 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Jun 3 13:15:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:15.130185 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-73045e47-3cfb-470d-9391-385d8c9e7b43 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:15.131205 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-73045e47-3cfb-470d-9391-385d8c9e7b43 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 03 13:15:15.131598 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 13:15:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:15:15.320736 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-14aac0d3-ebca-4eca-9fd2-202205ea44cb admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:15.326522 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.wsgi [None req-14aac0d3-ebca-4eca-9fd2-202205ea44cb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-14aac0d3-ebca-4eca-9fd2-202205ea44cb admin admin] Request method failure captured: Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Accept: application/json Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Accept-Encoding: gzip, deflate Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Connection: keep-alive Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Content-Length: 0 Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Host: 10.222.0.61 Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Openstack-Api-Version: compute 2.90 Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Openstack-System-Scope: None Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: User-Agent: python-novaclient Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Auth-Token: gAAAAABimgljspFjQTSZD18olHIaowTkDYtRTX8tfIBV7iUjjAXDHndDgk8p4ogYzzD8HzjKTDQkAynLS-NaXPPSIF9w29HHrojmV72bb7McE_GLdXXmftEj92DcOZzwl33MtJ1EHROqu5-NieHanYQgN9hC180gg28MhR_MZV_ftgcEnGhUI6Q Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Domain-Id: None Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Domain-Name: None Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Identity-Status: Confirmed Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Is-Admin-Project: True Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Project-Domain-Id: default Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Project-Domain-Name: Default Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Project-Id: ade16b49bacd4a0789895b9341a45a4d Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Project-Name: admin Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Role: reader,admin,member Jun 03 13:15:15.328000 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Roles: reader,admin,member Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade16b49bacd4a0789895b9341a45a4d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Tenant: admin Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Tenant-Id: ade16b49bacd4a0789895b9341a45a4d Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-Tenant-Name: admin Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User: admin Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User-Domain-Id: default Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User-Domain-Name: Default Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User-Id: 31e8e6595d7242a98c3388e4c3784e70 Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: X-User-Name: admin Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: method: > Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: exception: Flavor 451 could not be found. Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: action_args: {'id': '451'} Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:15:15.329549 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:15:15.331611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: ERROR nova.api.openstack.wsgi Jun 03 13:15:15.333010 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-14aac0d3-ebca-4eca-9fd2-202205ea44cb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:15:15.334216 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-14aac0d3-ebca-4eca-9fd2-202205ea44cb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060488 Jun 03 13:15:15.334216 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jun 3 13:15:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:15.339752 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-29f14302-f2ab-48f8-bac6-1b9f58c43400 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:15.354060 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-29f14302-f2ab-48f8-bac6-1b9f58c43400 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017957 Jun 03 13:15:15.354585 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jun 3 13:15:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:15.363950 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:15.377427 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017214 Jun 03 13:15:15.378014 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jun 3 13:15:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:15.387376 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-30e407c8-53a3-4793-9583-724e776004c9 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:15.392687 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.wsgi [None req-30e407c8-53a3-4793-9583-724e776004c9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-30e407c8-53a3-4793-9583-724e776004c9 admin admin] Request method failure captured: Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Accept: application/json Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Accept-Encoding: gzip, deflate Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Connection: keep-alive Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Content-Length: 0 Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Host: 10.222.0.61 Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Openstack-Api-Version: compute 2.90 Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Openstack-System-Scope: None Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: User-Agent: python-novaclient Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Auth-Token: gAAAAABimgljspFjQTSZD18olHIaowTkDYtRTX8tfIBV7iUjjAXDHndDgk8p4ogYzzD8HzjKTDQkAynLS-NaXPPSIF9w29HHrojmV72bb7McE_GLdXXmftEj92DcOZzwl33MtJ1EHROqu5-NieHanYQgN9hC180gg28MhR_MZV_ftgcEnGhUI6Q Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Domain-Id: None Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Domain-Name: None Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Identity-Status: Confirmed Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Is-Admin-Project: True Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Project-Domain-Id: default Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Project-Domain-Name: Default Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Project-Id: ade16b49bacd4a0789895b9341a45a4d Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Project-Name: admin Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Role: reader,admin,member Jun 03 13:15:15.394208 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Roles: reader,admin,member Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade16b49bacd4a0789895b9341a45a4d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade16b49bacd4a0789895b9341a45a4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Tenant: admin Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Tenant-Id: ade16b49bacd4a0789895b9341a45a4d Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-Tenant-Name: admin Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User: admin Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User-Domain-Id: default Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User-Domain-Name: Default Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User-Id: 31e8e6595d7242a98c3388e4c3784e70 Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: X-User-Name: admin Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: method: > Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: exception: Flavor 451 could not be found. Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: action_args: {'id': '451'} Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:15:15.395876 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:15:15.396747 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: ERROR nova.api.openstack.wsgi Jun 03 13:15:15.398572 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-30e407c8-53a3-4793-9583-724e776004c9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:15:15.399672 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-30e407c8-53a3-4793-9583-724e776004c9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011642 Jun 03 13:15:15.399672 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jun 3 13:15:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 03 13:15:16.262512 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:16.263524 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 03 13:15:16.263916 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 13:15:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:15:16.452120 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-306330a8-9189-45a1-8b1b-209740803d21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:15:16.554901 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-306330a8-9189-45a1-8b1b-209740803d21 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.153892 Jun 03 13:15:16.555481 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Jun 3 13:15:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:15:17.427734 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:17.428846 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 03 13:15:17.429251 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 13:15:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:15:17.618615 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-1648331c-fc1c-42cd-8413-757cd8fcc18a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:15:17.703725 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-1648331c-fc1c-42cd-8413-757cd8fcc18a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.136528 Jun 03 13:15:17.704219 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Jun 3 13:15:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:15:18.578747 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:18.579816 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 03 13:15:18.580250 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 13:15:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:15:18.771567 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-0ac540a7-7359-4f05-9a9b-d69f71de561a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:15:18.844386 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-0ac540a7-7359-4f05-9a9b-d69f71de561a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.126068 Jun 03 13:15:18.844937 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Jun 3 13:15:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:15:19.724660 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:19.725665 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 03 13:15:19.726179 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 13:15:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:15:19.916365 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-2991e6cb-b77b-4100-b2fe-da080eac595e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:15:19.996574 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-2991e6cb-b77b-4100-b2fe-da080eac595e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.132255 Jun 03 13:15:19.997123 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Jun 3 13:15:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:15:20.871202 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:20.872270 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001917 Jun 03 13:15:20.872671 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 13:15:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:15:21.065770 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-930c1358-59b7-476a-aa59-105906e4e406 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:21.085656 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-930c1358-59b7-476a-aa59-105906e4e406 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070336 Jun 03 13:15:21.086112 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Fri Jun 3 13:15:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:16:22.457046 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:22.458076 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-4282aaf2-c3c8-4f7b-a41f-bc8c35a94eae admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 03 13:16:22.458467 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 13:16:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:16:22.465985 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:22.517631 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-b7101ec3-4862-4157-84f8-f386e1dcee9a admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:22.539967 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-b7101ec3-4862-4157-84f8-f386e1dcee9a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075442 Jun 03 13:16:22.540522 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1291 bytes} [Fri Jun 3 13:16:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:22.560787 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG dbcounter [-] [103740] Writing DB stats nova_api:SELECT=14 {{(pid=103740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:22.564521 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-6b464695-60c0-4518-8350-1840c63a4a4a admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:22.572363 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-6b464695-60c0-4518-8350-1840c63a4a4a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012973 Jun 03 13:16:22.572887 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1282 bytes} [Fri Jun 3 13:16:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:16:22.584958 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-517ecba8-c89a-415b-9ffa-ce81dd6b6dd4 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:22.592812 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-517ecba8-c89a-415b-9ffa-ce81dd6b6dd4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012188 Jun 03 13:16:22.593329 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1285 bytes} [Fri Jun 3 13:16:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:16:22.605335 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-8eb883c2-40c7-4935-82ee-ccb91e4a2d3c admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:22.613248 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-8eb883c2-40c7-4935-82ee-ccb91e4a2d3c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011474 Jun 03 13:16:22.613763 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1285 bytes} [Fri Jun 3 13:16:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:16:22.625238 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-4bffdcf5-5a2b-4ea3-a67a-2d87d5819486 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:22.632719 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-4bffdcf5-5a2b-4ea3-a67a-2d87d5819486 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010995 Jun 03 13:16:22.633232 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1282 bytes} [Fri Jun 3 13:16:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:43.421536 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-8eb883c2-40c7-4935-82ee-ccb91e4a2d3c admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:43.422553 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-8eb883c2-40c7-4935-82ee-ccb91e4a2d3c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 03 13:19:43.422960 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 13:19:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:19:43.578769 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_api:SELECT=6 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:19:43.691719 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-626bf9f4-ba74-41af-baef-6681a210d588 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:43.692922 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:19:43.692922 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: warnings.warn(msg) Jun 03 13:19:43.694122 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-626bf9f4-ba74-41af-baef-6681a210d588 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:43.694564 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-626bf9f4-ba74-41af-baef-6681a210d588 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:43.695510 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-626bf9f4-ba74-41af-baef-6681a210d588 admin admin] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:43.695789 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-626bf9f4-ba74-41af-baef-6681a210d588 admin admin] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:43.731091 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-626bf9f4-ba74-41af-baef-6681a210d588 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153762 Jun 03 13:19:43.731659 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jun 3 13:19:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:19:44.604981 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-8eb883c2-40c7-4935-82ee-ccb91e4a2d3c admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:44.606611 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-8eb883c2-40c7-4935-82ee-ccb91e4a2d3c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 03 13:19:44.607015 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 13:19:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:19:44.797993 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-a4b3bbe1-ab50-4cdc-b8db-76210e4d01f4 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:44.797993 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:19:44.797993 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: warnings.warn(msg) Jun 03 13:19:44.798875 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-a4b3bbe1-ab50-4cdc-b8db-76210e4d01f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:44.799331 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-a4b3bbe1-ab50-4cdc-b8db-76210e4d01f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:44.800102 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-a4b3bbe1-ab50-4cdc-b8db-76210e4d01f4 admin admin] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:44.800552 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-a4b3bbe1-ab50-4cdc-b8db-76210e4d01f4 admin admin] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:44.826611 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-a4b3bbe1-ab50-4cdc-b8db-76210e4d01f4 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076749 Jun 03 13:19:44.826611 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jun 3 13:19:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:19:56.116381 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-8eb883c2-40c7-4935-82ee-ccb91e4a2d3c admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:56.117386 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-8eb883c2-40c7-4935-82ee-ccb91e4a2d3c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 03 13:19:56.117784 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 13:19:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:19:56.262891 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_cell0:SELECT=4 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:19:56.263513 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_cell1:SELECT=4 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:19:56.264128 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG dbcounter [-] [103741] Writing DB stats nova_api:SELECT=8 {{(pid=103741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:19:56.312827 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-3f426284-0464-47f2-9960-23b733cb9bf5 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:56.313999 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:19:56.313999 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: warnings.warn(msg) Jun 03 13:19:56.315211 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-3f426284-0464-47f2-9960-23b733cb9bf5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:56.315729 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-3f426284-0464-47f2-9960-23b733cb9bf5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:56.316563 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-3f426284-0464-47f2-9960-23b733cb9bf5 admin admin] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:56.317023 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-3f426284-0464-47f2-9960-23b733cb9bf5 admin admin] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:56.342905 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-3f426284-0464-47f2-9960-23b733cb9bf5 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084453 Jun 03 13:19:56.343451 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jun 3 13:19:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:19:57.210605 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: DEBUG nova.api.openstack.wsgi [None req-8eb883c2-40c7-4935-82ee-ccb91e4a2d3c admin admin] Calling method '>' {{(pid=103740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:57.211633 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: INFO nova.api.openstack.requestlog [None req-8eb883c2-40c7-4935-82ee-ccb91e4a2d3c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 03 13:19:57.212027 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: [pid: 103740|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 13:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:19:57.411427 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG nova.api.openstack.wsgi [None req-9bb4076c-5373-45a5-98df-3f89f46dbcc1 admin admin] Calling method '>' {{(pid=103741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:57.411427 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:19:57.411427 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: warnings.warn(msg) Jun 03 13:19:57.411427 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-9bb4076c-5373-45a5-98df-3f89f46dbcc1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:57.411427 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-9bb4076c-5373-45a5-98df-3f89f46dbcc1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:57.412460 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-9bb4076c-5373-45a5-98df-3f89f46dbcc1 admin admin] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:57.412615 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: DEBUG oslo_concurrency.lockutils [None req-9bb4076c-5373-45a5-98df-3f89f46dbcc1 admin admin] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:57.438847 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: INFO nova.api.openstack.requestlog [None req-9bb4076c-5373-45a5-98df-3f89f46dbcc1 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088761 Jun 03 13:19:57.439406 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: [pid: 103741|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jun 3 13:19:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:20:52.508554 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: Fri Jun 3 13:20:52 2022 - graceful shutdown triggered... Jun 03 13:20:52.509103 dv-cinder-801354-5-iscsi devstack@n-api.service[103740]: Gracefully killing worker 1 (pid: 103740)... Jun 03 13:20:52.508668 dv-cinder-801354-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 03 13:20:52.509960 dv-cinder-801354-5-iscsi devstack@n-api.service[103741]: Gracefully killing worker 2 (pid: 103741)... Jun 03 13:20:53.509222 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: worker 1 buried after 1 seconds Jun 03 13:20:53.509803 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: worker 2 buried after 1 seconds Jun 03 13:20:53.509803 dv-cinder-801354-5-iscsi devstack@n-api.service[103739]: goodbye to uWSGI. Jun 03 13:20:53.510787 dv-cinder-801354-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 03 13:20:53.511355 dv-cinder-801354-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 03 13:20:53.514050 dv-cinder-801354-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 13:20:53.530692 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 13:20:53.552992 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 13:20:53 2022] *** Jun 03 13:20:53.552992 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 13:20:53.552992 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 13:20:53.552992 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: nodename: dv-cinder-801354-5-iscsi Jun 03 13:20:53.552992 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: machine: x86_64 Jun 03 13:20:53.552992 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: clock source: unix Jun 03 13:20:53.552992 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: pcre jit disabled Jun 03 13:20:53.552992 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: detected number of CPU cores: 4 Jun 03 13:20:53.552992 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: current working directory: / Jun 03 13:20:53.552992 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: detected binary path: /usr/bin/uwsgi-core Jun 03 13:20:53.552992 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: your processes number limit is 47680 Jun 03 13:20:53.552992 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: your memory page size is 4096 bytes Jun 03 13:20:53.553869 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: detected max file descriptor number: 2048 Jun 03 13:20:53.553869 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: lock engine: pthread robust mutexes Jun 03 13:20:53.553869 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: thunder lock: enabled Jun 03 13:20:53.553869 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 13:20:53.553869 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 13:20:53.599588 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: Python main interpreter initialized at 0x557bb80619c0 Jun 03 13:20:53.599588 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: python threads support enabled Jun 03 13:20:53.599588 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: your server socket listen backlog is limited to 100 connections Jun 03 13:20:53.599588 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: your mercy for graceful operations on workers is 90 seconds Jun 03 13:20:53.600043 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 13:20:53.600043 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: *** Operational MODE: preforking *** Jun 03 13:20:53.600304 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: *** uWSGI is running in multiple interpreter mode *** Jun 03 13:20:53.600304 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: spawned uWSGI master process (pid: 118162) Jun 03 13:20:53.600511 dv-cinder-801354-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 13:20:53.601627 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: spawned uWSGI worker 1 (pid: 118178, cores: 1) Jun 03 13:20:53.601627 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: spawned uWSGI worker 2 (pid: 118179, cores: 1) Jun 03 13:20:53.601627 dv-cinder-801354-5-iscsi devstack@n-api.service[118162]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 13:20:54.850009 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 13:20:54.872533 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 13:20:55.702040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:20:55.702040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: from cryptography.utils import int_from_bytes Jun 03 13:20:55.702382 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:20:55.702382 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: from cryptography.utils import int_from_bytes Jun 03 13:20:55.715961 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:20:55.715961 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: from cryptography.utils import int_from_bytes Jun 03 13:20:55.716338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:20:55.716338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: from cryptography.utils import int_from_bytes Jun 03 13:20:58.136820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 13:20:58.137480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 13:20:58.137588 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 13:20:58.137964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 13:20:58.138229 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 13:20:58.138623 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.138885 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 13:20:58.139266 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.139377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 13:20:58.139465 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.139556 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.139676 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 13:20:58.139894 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.140050 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 13:20:58.140237 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.140337 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 13:20:58.140611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.140847 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.141133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.141416 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.141525 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.141728 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.141827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.142053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.142152 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.142385 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-5-iscsi {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.142544 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.142713 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.142879 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.143035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.143213 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.143350 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.143541 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.143676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.143881 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.143981 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.144175 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.144332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.144491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.144644 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.144824 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-5-iscsi {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.145151 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.145311 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.145458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.145780 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.145879 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.146110 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.146225 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.146422 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.146537 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.146754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.146863 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.147069 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.147190 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.147427 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.147574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.147761 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.147909 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.148079 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.148229 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.148442 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.148607 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.148762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.148895 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.149150 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-5-iscsi {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.149247 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.149467 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.149585 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.149784 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.149898 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.150097 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.150197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.150425 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.150514 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.150741 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.150853 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.151119 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.151223 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-5-iscsi {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.151446 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.151632 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.151760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.151859 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.152074 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.152189 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.152434 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.152530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.152761 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.152861 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.153086 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.153185 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.153414 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.153515 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.153721 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.153826 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.154037 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.154141 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.154351 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.154459 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.154676 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.154775 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.154985 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.155077 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.155294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.155454 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.155545 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.155637 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.155849 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.155949 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.156750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.156963 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.157251 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.157368 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.157678 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.157790 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.157942 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.158038 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.158201 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.158301 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.158532 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.158626 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.158870 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.159005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.159189 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.159296 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.159504 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.159624 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.159790 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.159893 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.160047 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.160186 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.160398 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.160517 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.160728 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.160886 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.161035 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.161204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.161363 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.161505 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.161654 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.161797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.161948 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.162095 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.162247 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.162388 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.162529 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.162672 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.162835 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.162985 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.163136 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.163325 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.163467 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.163615 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.163757 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.163917 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.164068 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.164251 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.164389 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.164538 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.164719 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.164870 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.165129 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.165246 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.165394 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.165557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.165708 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.165812 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.166056 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.166157 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.166365 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.166456 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.166686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.166787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.167013 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.167151 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.167324 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.167486 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.167631 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.167787 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.167937 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.168098 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.168218 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.168319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.168495 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.168602 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.168808 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.168994 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.169140 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.169279 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.169435 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.169579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.169728 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.169889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.170039 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.170189 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.170340 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.170583 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.170728 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.170878 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.171028 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.171180 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.171337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.171480 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.171647 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.171795 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.172022 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.173911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.175137 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.175291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.175431 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.175581 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.175752 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.175902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.176056 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.176248 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.176387 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.176540 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.176689 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.176866 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.177019 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.177171 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.177332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.177555 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.177710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.177852 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.178002 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.178152 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.178307 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.178449 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.178592 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.178733 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.178891 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.179043 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.179191 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.179283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.179377 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.179472 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.179568 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.179660 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.179744 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.179827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.179918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.180015 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.180108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.180210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.180295 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.180391 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.180487 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.180574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.180664 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.180755 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.180845 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.180937 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.181105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.181200 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.181286 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.181376 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.181461 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.181544 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.181641 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.181733 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.181868 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.181966 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.182059 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.182144 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.182242 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.182329 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.182412 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.182503 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.182594 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.182687 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.182785 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.182872 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.182956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.183123 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.183261 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.183428 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.183587 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.183734 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.183929 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.184058 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.184295 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.184408 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.184647 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.184740 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.184968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.185062 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.185305 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.185411 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.185632 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:20:58.185776 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.185955 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.186057 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.186273 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.186367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.186591 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.186690 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.186923 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.187017 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.187324 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.187490 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.187649 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.187805 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.188122 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.188339 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.188460 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.188682 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.188787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.189007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.189145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.189344 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.189455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.189665 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.189765 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.189992 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.190103 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.190311 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.190411 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.190637 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.190739 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.190963 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.191056 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.191300 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.191401 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.191618 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.191712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.191939 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.192031 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.192289 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.192399 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.192610 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.192704 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.192936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.193030 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.193269 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.193372 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.193584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.193676 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.193901 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.193994 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.194217 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.194319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.194547 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.194639 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.194881 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.194981 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.195199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.195301 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.195525 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.195620 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.195878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.195994 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.196177 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.196273 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.196486 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.196591 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.196802 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.196900 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.197118 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.197213 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.197443 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.197580 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.197770 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.197874 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.198087 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.198199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.198401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.198503 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.198714 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.198830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.199027 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.199151 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.199341 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.199460 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.199651 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.199753 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.199959 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.200061 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.200294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.200402 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.200604 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.200712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.200917 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.201018 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.201226 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.201320 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.201553 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.201664 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.201886 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.201986 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.202198 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.202309 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.202513 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.202618 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.202823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.202917 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.203189 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.203290 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.203510 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.203782 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.203883 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.204125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.204273 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.204467 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.204573 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.204784 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.204884 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.205094 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.205201 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.205423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.205535 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.205738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.205832 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.206055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.206177 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.206372 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.206492 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.206680 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.206782 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.206988 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.207090 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.207303 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.207411 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.207614 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.207728 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.207934 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.208059 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.208275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.208389 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.208587 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.208689 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.208914 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.209016 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.209224 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.209326 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.209538 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.209658 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.209861 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.209962 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.210178 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.210281 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.210497 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.210600 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.210827 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.211160 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.211262 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.211479 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.211583 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.211787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.211891 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.212102 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.212276 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.212437 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.212538 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.212746 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.212846 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.213053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.213149 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.213367 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.213461 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.213678 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.213779 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.213988 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.214088 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.214298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.214398 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.214606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.214709 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.214915 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.215014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.215243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.215351 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.215558 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.215660 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.215866 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.215968 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.216198 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.216312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.216510 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.216627 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.216823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.216925 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.217134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.217252 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.217444 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.217557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.217753 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.217858 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.218082 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.218192 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.218399 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.218510 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.219240 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.219357 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.219706 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.219872 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.220035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.220264 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.220396 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.220630 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.220735 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.220950 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.221054 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.221305 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.221409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.221636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.221737 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.221963 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.222069 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.222282 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.222398 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.222602 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.222696 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.222915 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.223009 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.223236 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.223328 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.223543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.223636 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.223861 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.223955 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.224200 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.224308 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.224532 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.224626 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.224850 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.224955 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.225176 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.225278 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.225490 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.225589 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.225814 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.225908 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.226131 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.226322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.226463 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.226600 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.226764 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.226917 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.227060 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.227201 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.227343 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.227499 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.227641 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.227802 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.227959 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.228301 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.228449 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.228598 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.228753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.228904 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.229053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.229202 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.229351 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.229507 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.229675 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.229847 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.229987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.230128 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.230277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.230428 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.230570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.230728 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.230896 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.231033 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.231185 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.231327 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.231468 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.231609 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.231757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.231906 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.232056 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.232246 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.232346 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.232495 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.232640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.232783 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.232956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.233107 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.233248 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.233396 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.233544 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.233712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.233855 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.233997 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.234146 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.234287 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.235053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.235273 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.235425 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.235687 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.235826 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.235998 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.236136 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.236342 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.236499 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.236643 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.236744 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.236972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.237073 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.237289 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.237393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.237616 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.237718 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.237939 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.238070 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.238299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.238501 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.238608 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.238695 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.238856 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.238964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.239170 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.239262 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.239479 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.239786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.239930 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.240095 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.240207 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.240451 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.240552 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.240770 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.241127 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.241339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.241430 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.241663 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.241757 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.241971 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.242082 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.242285 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.242386 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.242604 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.242698 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.242919 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.243023 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.243245 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.243375 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.243541 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.243634 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.243852 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.243946 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.244200 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.244326 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.244503 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.244611 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.244818 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.244931 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.245134 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.245283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.245434 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.245577 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.245746 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.245896 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.246044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.246187 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.246363 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.246665 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.246826 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.246978 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.247120 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.247261 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.247402 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.247557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.247720 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.247864 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.248012 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.248182 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.248323 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.248533 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.248642 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.248844 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.249140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.249290 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.249382 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.249488 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.249575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.249813 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.250008 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.250190 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.250370 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.250526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.250743 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.250889 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.251068 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.251215 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.251398 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.251550 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.251759 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.252050 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.252246 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.252398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.252492 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.252758 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.252861 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.253023 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.253118 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.253331 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.253424 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.253645 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.253737 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.253954 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.254057 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.254264 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.254364 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.254573 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.254666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.254883 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.254986 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.255202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.255310 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.255509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.255610 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.255822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.255917 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.256132 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.256272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.256464 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.256583 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.256777 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.256873 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.257086 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.257188 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.257396 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.257488 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.257702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.257802 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.258014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.258116 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.258330 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.258525 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.258775 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.258932 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.259089 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.259243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.259396 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.259540 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.259683 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.259825 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.259982 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.260132 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.260405 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.260516 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.260606 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.260699 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.260834 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.260931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.261070 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.261172 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.261379 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.261482 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.261731 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.261834 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.262043 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.262137 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.262362 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.262465 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.262681 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.262838 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.263016 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.263160 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.263296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.263401 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.263602 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.263696 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.263915 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.264008 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.264245 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.264355 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.264569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.264663 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.264878 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.264969 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.265184 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.265289 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.265491 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.265611 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.265862 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.265963 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.266177 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.266411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.266503 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.266735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.266866 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.267058 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.267207 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.267377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.267470 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.267682 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.267777 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.267990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.268202 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.268323 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.268445 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.268637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.268754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.268953 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.269075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.269258 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.269359 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.269566 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.269659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.269893 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.270002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.270193 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.270297 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.270500 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.270600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.270811 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.270912 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.271118 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.271217 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.271423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.271592 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.271734 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.271828 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.272042 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.272134 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.272375 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.272484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.272686 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.272817 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.272997 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.273091 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.273304 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.273411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.273613 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.273706 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.273922 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.274024 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.274232 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.274338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.274537 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.274636 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.274844 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.274944 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.275150 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.275318 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.275455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.275547 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.275763 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.275857 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.276091 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.276224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.276430 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.276523 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.276738 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.276837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.277048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.277178 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.277355 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.277458 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.277665 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.277766 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.277975 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.278070 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.278289 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.278389 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.278599 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.278692 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.278910 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.279125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.279221 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.279321 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.279519 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.279637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.279833 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.279943 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.280216 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.280339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.280506 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.280611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.280810 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.280914 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.281119 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.281759 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.282021 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.282131 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.282336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.282639 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.282734 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.282970 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.283076 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.283283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.283377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.283601 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.283703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.283928 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.284021 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.284282 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.284380 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.284614 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.284706 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.284921 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.285024 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.285236 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.285344 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.285547 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.285701 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.285859 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.285965 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.286174 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.286268 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.286490 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.286593 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.286797 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.286899 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.287115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.287248 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.287428 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.287577 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.287732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.287889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.288031 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.288227 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.288376 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.288520 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.288670 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.288825 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.288977 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.289203 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.289361 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.289513 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.289669 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.289822 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.289971 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.290113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.290254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.290393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.290504 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.290591 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.290788 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.290885 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.291105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.291207 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.291413 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.291508 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.291729 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.291830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.292048 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.292160 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.292391 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.292545 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.292706 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.292855 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.293026 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.293173 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.293342 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.293490 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.293655 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.293812 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.293988 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.294133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.294304 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.294444 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.294614 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.294870 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.294972 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.295186 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.295289 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.295503 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.295618 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.295817 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.295912 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.296126 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.296269 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.296460 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.296582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.296774 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.296954 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.297788 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.298001 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.298122 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.298408 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.298581 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.298745 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.298914 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.299132 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.299243 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.299327 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.299407 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.299656 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.299764 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.300082 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.300210 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.300437 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.300575 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.300756 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.300932 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.301083 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.301238 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.301383 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.301545 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.301690 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.301840 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.301997 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.302157 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.302308 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.302463 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.302614 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.302757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.302906 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.303048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.303207 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.303364 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.303515 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.303657 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.303808 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.303950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.304110 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.304309 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.304530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.304624 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.304851 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.304947 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.305164 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.305319 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.305553 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.305656 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.305886 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.306047 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.306203 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.306325 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.307012 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.307139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.307139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.307353 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.307466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.307580 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.307580 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.307809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.307931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.308053 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.308237 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.308378 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.308552 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.308685 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.308865 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.309012 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.309277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.309430 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.309630 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.309780 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.309914 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.310052 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.310185 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.310324 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.310632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.310777 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.310911 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.311042 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.311173 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.311314 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.311582 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.311724 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.311857 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.311988 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.312206 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.312312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.312400 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.312563 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.312729 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.312920 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.313167 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.313314 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.313498 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.313592 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.313814 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.313909 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.314135 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.314236 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.314451 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.314544 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.314766 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.314860 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.315086 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.315178 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.315397 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.315491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.315707 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.315809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.316020 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.316120 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.316363 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.316474 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.316679 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.316771 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.316993 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.317095 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.317323 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.317431 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.317634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.317727 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.317965 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.318112 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.318287 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.318394 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.318611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.318704 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.318937 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.319031 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.319265 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.319412 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.319567 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.319727 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.319879 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.320022 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.320210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.320321 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.320527 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.320667 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.320838 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.320934 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.321146 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.321240 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.321458 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.321567 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.321765 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.321866 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.322073 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.322168 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.322382 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.322475 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.322712 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.322805 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.323020 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.323144 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.323348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.323477 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.323662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.323765 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.323969 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.324071 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.324302 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.328803 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.328953 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.329071 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.329173 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.329263 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.329356 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.329441 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.329441 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.329677 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.329764 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.329908 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.329998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.330130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.330218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.330362 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.330504 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.330636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.330766 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.330895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.331075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.331209 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.331298 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.331382 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.331464 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.331546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.331644 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.331736 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.331736 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.331888 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.331978 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.332061 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.332184 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.332273 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.332357 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.332452 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.332537 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.332651 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.332750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.332842 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.332926 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.333068 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.333068 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.333244 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.333336 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.333420 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.333552 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.333648 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.333740 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.333831 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.333923 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.334008 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.334090 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.334180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.334271 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.334363 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.334483 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.334571 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.334663 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.334757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.334840 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.334933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.335024 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.335107 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.335190 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.335280 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.335458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.335552 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.335637 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.335727 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.335819 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.335907 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.335999 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.336090 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.336378 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.336472 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.336701 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.336794 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.337021 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.337112 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.337341 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.337432 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.337661 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.337766 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.337989 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.338130 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.338314 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.338466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.338624 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.338778 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.338940 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.339039 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.339252 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.339344 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.339564 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.339657 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.339887 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.340029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.340229 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.340325 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.340547 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.340651 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.340862 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.340954 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.341180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.341320 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.341498 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.341592 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.341826 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.341918 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.342167 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.342334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.342493 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.342585 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.342811 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.342910 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.343131 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.343237 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.343456 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.343572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.344303 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.344535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.344859 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.344960 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.345199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.345292 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.345523 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.345610 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.345846 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.345989 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.346168 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.346268 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.346484 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.346574 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.346803 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.346897 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.347114 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.347280 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.347424 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.347517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.347741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.347834 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.348056 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.348208 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.348391 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.356003 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.356099 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.356261 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.356353 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.356437 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.356528 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.356622 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.356707 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.356799 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.356883 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.356974 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.357071 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.357167 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.357258 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.357342 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.357433 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.357518 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.357601 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.357698 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.357783 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.357873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.357957 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.358040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.358131 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.358222 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.358314 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.358404 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.358498 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.358583 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.358698 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.358842 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.358974 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.359104 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.359192 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.359276 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.360099 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.360361 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.360486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.360618 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.360756 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.360886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.360987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.361171 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.361278 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.361278 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.361492 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.361637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.361733 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.361825 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.361918 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.362011 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.362095 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.362192 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.362283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.362374 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.362458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.362540 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.362629 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.362727 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.362811 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.362904 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.362994 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.363079 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.363162 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.363261 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.363346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.363436 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.363520 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.363610 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.363707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.363792 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.363792 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.364005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.364099 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.364199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.364302 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.364394 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.364478 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.364560 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.364651 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.364741 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.364835 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.364928 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.365019 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.365103 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.365193 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.365284 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.365378 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.365469 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.365552 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.365643 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.365727 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.366071 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.366168 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.366254 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.366422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.366512 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.366604 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.366697 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.366782 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.366864 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.366864 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.367023 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.367113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.367207 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.367293 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.367375 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.367458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.367547 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.367631 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.367727 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.367822 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.367906 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.367996 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.368088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.368212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.368299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.368382 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.368465 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.368547 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.368629 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.368725 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.368810 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.368977 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.369119 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.369293 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.369436 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.369624 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.369751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.369943 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.370065 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.370258 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.370385 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.370613 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.370706 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.370943 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.371038 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.371292 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.371492 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.371593 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.371836 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.371940 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.372183 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.372402 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.372596 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.372700 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.372864 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.372955 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.373180 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.373273 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.373492 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.373595 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.373802 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.373902 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.374123 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.374227 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.374439 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.374530 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.374752 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.374857 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.375167 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.375273 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.375416 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.375660 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.375754 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.375988 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.376081 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.376338 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.376449 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.376658 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.376752 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.376976 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.377104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.377293 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.377421 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.377612 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.377746 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.377928 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.378071 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.378243 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.378388 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.378557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.378716 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.378879 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.379048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.379235 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.379354 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.379559 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.379670 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.379881 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.379980 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.380230 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.380345 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.380557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.380660 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.380884 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.381039 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.381190 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.381335 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.381503 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.381597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.381842 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.381947 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.382165 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.382268 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.382480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.382581 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.382807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.382908 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.383115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.383214 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.383419 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.383545 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.383728 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.383862 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.384031 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.384366 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.384675 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.384864 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.384984 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.385211 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.385344 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.385540 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.385659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.385882 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.385988 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.386189 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.386290 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.386497 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.386604 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.386804 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.386930 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.387114 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.387242 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.387421 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.387548 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.387736 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.387861 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.388044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.388217 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.388379 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.388523 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.388687 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.388820 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.388994 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.389126 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.389382 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.389534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.389672 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.389801 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.389950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.390081 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.390280 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.390415 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.390643 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.390777 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.391074 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.391205 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.391405 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.391620 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.391757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.391944 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.392078 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.392289 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.392435 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.392610 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.392750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.392926 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.393059 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.393245 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.393379 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.393558 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.393699 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.393873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.393969 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.394185 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.394278 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.394496 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.394597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.394809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.394905 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.395120 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.395264 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.395437 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.395588 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.395748 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.395848 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.396060 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.396173 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.396396 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.396488 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.396708 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.396819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.397018 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.397111 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.397345 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.397443 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.397662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.397768 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.397997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.398089 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.398314 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.398414 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.398627 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.398734 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.398948 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.399040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.399259 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.399357 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.399574 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.399679 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.399894 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.399997 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.400234 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.400329 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.400554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.400655 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.400890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.400981 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.401204 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.401294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.401522 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.401664 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.401839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.401932 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.402158 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.402257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.402474 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.402569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.402791 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.402883 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.403126 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.403302 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.403457 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.403551 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.403769 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.403868 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.404075 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.404201 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.404349 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 13:20:58.404443 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.404745 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.405069 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.405388 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.405727 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.406044 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.406940 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.407458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.407784 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.408108 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.408462 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.408790 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.409131 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.409467 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.409790 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.410124 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.410461 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.410825 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.411146 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.411501 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.411839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.412175 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.412502 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.412840 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:20:58.413104 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 13:20:58.465992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO dbcounter [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] Registered counter for database nova_api Jun 03 13:20:58.475800 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO dbcounter [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] Registered counter for database nova_api Jun 03 13:20:58.488727 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_db.sqlalchemy.engines [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:20:58.496084 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writer thread running {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:20:58.497045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_db.sqlalchemy.engines [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:20:58.504185 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writer thread running {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:20:58.558262 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.context [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49069df2-a830-4b3d-8fbf-b69025d043f4(cell1) {{(pid=118179) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 13:20:58.563223 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:58.564292 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.context [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49069df2-a830-4b3d-8fbf-b69025d043f4(cell1) {{(pid=118178) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 13:20:58.565131 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:58.566013 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:58.568156 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:58.568442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:58.570048 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:58.570213 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO dbcounter [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] Registered counter for database nova_cell0 Jun 03 13:20:58.570853 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:58.572953 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:58.574148 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO dbcounter [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] Registered counter for database nova_cell1 Jun 03 13:20:58.574951 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO dbcounter [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] Registered counter for database nova_cell0 Jun 03 13:20:58.579939 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO dbcounter [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] Registered counter for database nova_cell1 Jun 03 13:20:58.583555 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_db.sqlalchemy.engines [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:20:58.585844 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_db.sqlalchemy.engines [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:20:58.589171 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_db.sqlalchemy.engines [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:20:58.592462 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writer thread running {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:20:58.595469 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_db.sqlalchemy.engines [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:20:58.597540 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writer thread running {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:20:58.733511 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writer thread running {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:20:58.743650 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writer thread running {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:20:58.744298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO dbcounter [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] Registered counter for database nova_cell0 Jun 03 13:20:58.751631 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_db.sqlalchemy.engines [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:20:58.753549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO dbcounter [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] Registered counter for database nova_cell0 Jun 03 13:20:58.756387 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writer thread running {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:20:58.766226 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_db.sqlalchemy.engines [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:20:58.772582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writer thread running {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:20:59.216090 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: WARNING keystonemiddleware.auth_token [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 13:20:59.227029 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: WARNING keystonemiddleware.auth_token [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 13:20:59.227969 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: WARNING keystonemiddleware.auth_token [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 13:20:59.235787 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: WARNING keystonemiddleware.auth_token [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 13:20:59.450912 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: WARNING keystonemiddleware.auth_token [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 13:20:59.457229 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: WARNING keystonemiddleware.auth_token [None req-8254718e-6d19-43ec-80df-6d0ba944b33d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 13:20:59.460696 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: WARNING keystonemiddleware.auth_token [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 13:20:59.462322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557bb80619c0 pid: 118179 (default app) Jun 03 13:20:59.466711 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: WARNING keystonemiddleware.auth_token [None req-a788c0fa-8a9b-46f9-aa2c-f58f1bd55597 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 13:20:59.471975 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557bb80619c0 pid: 118178 (default app) Jun 03 13:21:41.923928 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:41.924639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:41.925576 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:41.926294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:42.058128 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=3 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:42.058938 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=3 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:42.059787 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=3 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:42.061816 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=3 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:42.586169 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f24f549c-cfa4-406a-abe1-3979122653ca tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Action: 'create', calling method: .version_select at 0x7f5bcaa31310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-500055363", "metadata": {"Type": "work"}}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f24f549c-cfa4-406a-abe1-3979122653ca tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Request method failure captured: Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 121 Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgrlYRAI-QJkiAUiNK9pv-U4QSiVn6CsnkiW_zWDc-y9zdbZ2YAIpqLj8ouD-QzvoLcFXNSmABHo3kW5GbMAIE1-Y0tU6_fKjIR7e9BWcC82lXfOGDQxaoaG1AVcok8HkSHdM9WLdohng3mj7uSGOhBMX5i6rXZaC0_v9j_HOyhEd1I Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 6d4f45d0a81a4dd3aab4f7531c859d3d Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:21:42.606036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6d4f45d0a81a4dd3aab4f7531c859d3d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 6d4f45d0a81a4dd3aab4f7531c859d3d Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesNegativeTest-1460973130-project Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 7d90fa0cecb84aa2b8064d0449560c3b Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesNegativeTest-1460973130-project Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-500055363", "metadata": {"Type": "work"}}} Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: Jun 03 13:21:42.607439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-500055363', 'metadata': {'Type': 'work'}}}} Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise error Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi '#$%' Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:21:42.608358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 13:21:42.610409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 13:21:42.611705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 13:21:42.611705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.611949 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-58e33029-eb91-402c-b6e0-dc783ccda937 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Action: 'create', calling method: .version_select at 0x7f5bcaa34550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-840617798"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:42.615080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f24f549c-cfa4-406a-abe1-3979122653ca tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:21:42.617066 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f24f549c-cfa4-406a-abe1-3979122653ca tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.698662 Jun 03 13:21:42.617853 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Jun 3 13:21:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 702 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:21:42.634873 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-557dcf37-0e4a-4f94-9571-d453f6677d61 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Action: 'create', calling method: .version_select at 0x7f5bca8cf670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1435643501", "metadata": {"Type": "work"}}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-557dcf37-0e4a-4f94-9571-d453f6677d61 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Request method failure captured: Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 120 Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgrlYRAI-QJkiAUiNK9pv-U4QSiVn6CsnkiW_zWDc-y9zdbZ2YAIpqLj8ouD-QzvoLcFXNSmABHo3kW5GbMAIE1-Y0tU6_fKjIR7e9BWcC82lXfOGDQxaoaG1AVcok8HkSHdM9WLdohng3mj7uSGOhBMX5i6rXZaC0_v9j_HOyhEd1I Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 6d4f45d0a81a4dd3aab4f7531c859d3d Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:21:42.638990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6d4f45d0a81a4dd3aab4f7531c859d3d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 6d4f45d0a81a4dd3aab4f7531c859d3d Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesNegativeTest-1460973130-project Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 7d90fa0cecb84aa2b8064d0449560c3b Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesNegativeTest-1460973130-project Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1435643501", "metadata": {"Type": "work"}}} Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: Jun 03 13:21:42.642992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1435643501', 'metadata': {'Type': 'work'}}}} Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise error Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi '0' Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:21:42.644751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 13:21:42.646093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 13:21:42.647764 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 13:21:42.647764 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.647764 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-557dcf37-0e4a-4f94-9571-d453f6677d61 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:21:42.647764 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-557dcf37-0e4a-4f94-9571-d453f6677d61 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010348 Jun 03 13:21:42.647764 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 2/2] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Jun 3 13:21:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:21:42.653488 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2a3bc606-b8be-4048-a0be-763e37d54400 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Action: 'create', calling method: .version_select at 0x7f5bcaa31670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-124144727", "metadata": {"Type": "work"}}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2a3bc606-b8be-4048-a0be-763e37d54400 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Request method failure captured: Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 118 Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgrlYRAI-QJkiAUiNK9pv-U4QSiVn6CsnkiW_zWDc-y9zdbZ2YAIpqLj8ouD-QzvoLcFXNSmABHo3kW5GbMAIE1-Y0tU6_fKjIR7e9BWcC82lXfOGDQxaoaG1AVcok8HkSHdM9WLdohng3mj7uSGOhBMX5i6rXZaC0_v9j_HOyhEd1I Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 6d4f45d0a81a4dd3aab4f7531c859d3d Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:21:42.657509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6d4f45d0a81a4dd3aab4f7531c859d3d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 6d4f45d0a81a4dd3aab4f7531c859d3d Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesNegativeTest-1460973130-project Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 7d90fa0cecb84aa2b8064d0449560c3b Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesNegativeTest-1460973130-project Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-124144727", "metadata": {"Type": "work"}}} Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: Jun 03 13:21:42.659096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-124144727', 'metadata': {'Type': 'work'}}}} Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise error Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi '' Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:21:42.659997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 13:21:42.675188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 13:21:42.677945 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 13:21:42.677945 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.677945 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2a3bc606-b8be-4048-a0be-763e37d54400 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:21:42.677945 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2a3bc606-b8be-4048-a0be-763e37d54400 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016963 Jun 03 13:21:42.677945 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 3/3] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Jun 3 13:21:42 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:21:42.681806 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-35666a2c-9bb9-4bfc-99a7-43222f9c2cad tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Calling method '.version_select at 0x7f5bca8e33a0>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:42.941146 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-35666a2c-9bb9-4bfc-99a7-43222f9c2cad tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] HTTP exception thrown: Volume tempest-invalid-1961925936 could not be found. Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-35666a2c-9bb9-4bfc-99a7-43222f9c2cad tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Request method failure captured: Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1961925936 HTTP/1.1 Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgrlYRAI-QJkiAUiNK9pv-U4QSiVn6CsnkiW_zWDc-y9zdbZ2YAIpqLj8ouD-QzvoLcFXNSmABHo3kW5GbMAIE1-Y0tU6_fKjIR7e9BWcC82lXfOGDQxaoaG1AVcok8HkSHdM9WLdohng3mj7uSGOhBMX5i6rXZaC0_v9j_HOyhEd1I Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 6d4f45d0a81a4dd3aab4f7531c859d3d Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:21:42.945257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6d4f45d0a81a4dd3aab4f7531c859d3d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 6d4f45d0a81a4dd3aab4f7531c859d3d Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesNegativeTest-1460973130-project Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 7d90fa0cecb84aa2b8064d0449560c3b Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesNegativeTest-1460973130-project Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Volume tempest-invalid-1961925936 could not be found. Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': 'tempest-invalid-1961925936'} Jun 03 13:21:42.946659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1961925936 could not be found. (HTTP 404) (Request-ID: req-5b2beeee-e390-4076-ac0e-9a8c011030fd) Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:42.947688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 13:21:42.949322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1961925936 could not be found. Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:21:42.951141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1961925936 could not be found. Jun 03 13:21:42.953275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.953275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:42.953275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.953275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.953275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:42.953275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:42.953275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:21:42.953275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:21:42.953275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1961925936 could not be found. Jun 03 13:21:42.953275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.955687 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-35666a2c-9bb9-4bfc-99a7-43222f9c2cad tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Returning 404 to user: Volume tempest-invalid-1961925936 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:21:42.956877 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-35666a2c-9bb9-4bfc-99a7-43222f9c2cad tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1961925936" status: 404 len: 99 microversion: 2.1 time: 0.279240 Jun 03 13:21:42.962361 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 4/4] 10.222.0.61 () {58 vars in 1217 bytes} [Fri Jun 3 13:21:42 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1961925936 => generated 99 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 03 13:21:42.989172 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5509e883-eb3a-44e0-acb9-a6e88cce7fe5 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006240 Jun 03 13:21:42.989172 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 5/5] 10.222.0.61 () {58 vars in 1139 bytes} [Fri Jun 3 13:21:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 13:21:42.999014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ba34f33d-0e94-4e66-84e3-79ba0847c953 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009705 Jun 03 13:21:43.002182 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 6/6] 10.222.0.61 () {58 vars in 1136 bytes} [Fri Jun 3 13:21:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 13:21:43.013891 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-90040896-40c0-43ff-a262-bdaace8a091d tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Calling method '.version_select at 0x7f5bca884790>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:43.047819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-90040896-40c0-43ff-a262-bdaace8a091d tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] HTTP exception thrown: Volume 27cedd87-ac9b-431e-8dd1-946e1bf5cb7b could not be found. Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-90040896-40c0-43ff-a262-bdaace8a091d tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Request method failure captured: Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: DELETE /compute/v2.1/os-volumes/27cedd87-ac9b-431e-8dd1-946e1bf5cb7b HTTP/1.1 Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgrlYRAI-QJkiAUiNK9pv-U4QSiVn6CsnkiW_zWDc-y9zdbZ2YAIpqLj8ouD-QzvoLcFXNSmABHo3kW5GbMAIE1-Y0tU6_fKjIR7e9BWcC82lXfOGDQxaoaG1AVcok8HkSHdM9WLdohng3mj7uSGOhBMX5i6rXZaC0_v9j_HOyhEd1I Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 6d4f45d0a81a4dd3aab4f7531c859d3d Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:21:43.066105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6d4f45d0a81a4dd3aab4f7531c859d3d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 6d4f45d0a81a4dd3aab4f7531c859d3d Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesNegativeTest-1460973130-project Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 7d90fa0cecb84aa2b8064d0449560c3b Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesNegativeTest-1460973130-project Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Volume 27cedd87-ac9b-431e-8dd1-946e1bf5cb7b could not be found. Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '27cedd87-ac9b-431e-8dd1-946e1bf5cb7b'} Jun 03 13:21:43.067603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27cedd87-ac9b-431e-8dd1-946e1bf5cb7b could not be found. (HTTP 404) (Request-ID: req-16a84464-ac09-4359-8e37-4f9430cb092f) Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:43.068546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 13:21:43.069854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27cedd87-ac9b-431e-8dd1-946e1bf5cb7b could not be found. Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 13:21:43.071130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:21:43.072486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27cedd87-ac9b-431e-8dd1-946e1bf5cb7b could not be found. Jun 03 13:21:43.072486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.072486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:43.072486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.072486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:43.072486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:43.072486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:43.072486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:21:43.072486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:21:43.072486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27cedd87-ac9b-431e-8dd1-946e1bf5cb7b could not be found. Jun 03 13:21:43.072486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.072486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-90040896-40c0-43ff-a262-bdaace8a091d tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Returning 404 to user: Volume 27cedd87-ac9b-431e-8dd1-946e1bf5cb7b could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:21:43.076900 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-90040896-40c0-43ff-a262-bdaace8a091d tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/27cedd87-ac9b-431e-8dd1-946e1bf5cb7b" status: 404 len: 109 microversion: 2.1 time: 0.060499 Jun 03 13:21:43.076900 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 7/7] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 13:21:43 2022] DELETE /compute/v2.1/os-volumes/27cedd87-ac9b-431e-8dd1-946e1bf5cb7b => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:21:43.100986 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1ed82232-6c59-4a7a-977e-816b251c66f7 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Calling method '.version_select at 0x7f5bca884280>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:43.197787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-1ed82232-6c59-4a7a-977e-816b251c66f7 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] HTTP exception thrown: Volume 6fec2be4-511e-477b-a353-ec581616e271 could not be found. Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1ed82232-6c59-4a7a-977e-816b251c66f7 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Request method failure captured: Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/os-volumes/6fec2be4-511e-477b-a353-ec581616e271 HTTP/1.1 Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgrlYRAI-QJkiAUiNK9pv-U4QSiVn6CsnkiW_zWDc-y9zdbZ2YAIpqLj8ouD-QzvoLcFXNSmABHo3kW5GbMAIE1-Y0tU6_fKjIR7e9BWcC82lXfOGDQxaoaG1AVcok8HkSHdM9WLdohng3mj7uSGOhBMX5i6rXZaC0_v9j_HOyhEd1I Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 6d4f45d0a81a4dd3aab4f7531c859d3d Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:21:43.200018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6d4f45d0a81a4dd3aab4f7531c859d3d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6d4f45d0a81a4dd3aab4f7531c859d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 6d4f45d0a81a4dd3aab4f7531c859d3d Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesNegativeTest-1460973130 Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesNegativeTest-1460973130-project Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 7d90fa0cecb84aa2b8064d0449560c3b Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesNegativeTest-1460973130-project Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Volume 6fec2be4-511e-477b-a353-ec581616e271 could not be found. Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '6fec2be4-511e-477b-a353-ec581616e271'} Jun 03 13:21:43.201606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6fec2be4-511e-477b-a353-ec581616e271 could not be found. (HTTP 404) (Request-ID: req-a82c487b-fb42-4b0c-b31b-69e7ee31a494) Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:43.203149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:21:43.204584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6fec2be4-511e-477b-a353-ec581616e271 could not be found. Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 13:21:43.205772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6fec2be4-511e-477b-a353-ec581616e271 could not be found. Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6fec2be4-511e-477b-a353-ec581616e271 could not be found. Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1ed82232-6c59-4a7a-977e-816b251c66f7 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] Returning 404 to user: Volume 6fec2be4-511e-477b-a353-ec581616e271 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:21:43.207124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1ed82232-6c59-4a7a-977e-816b251c66f7 tempest-VolumesNegativeTest-1460973130 tempest-VolumesNegativeTest-1460973130-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6fec2be4-511e-477b-a353-ec581616e271" status: 404 len: 109 microversion: 2.1 time: 0.116320 Jun 03 13:21:43.216513 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 8/8] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:21:43 2022] GET /compute/v2.1/os-volumes/6fec2be4-511e-477b-a353-ec581616e271 => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:21:43.669961 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-58e33029-eb91-402c-b6e0-dc783ccda937 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.617933 Jun 03 13:21:43.670724 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 1/9] 10.222.0.61 () {60 vars in 1154 bytes} [Fri Jun 3 13:21:42 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1621 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 03 13:21:43.683279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b06bbb33-b4c9-42c6-9705-f7e78d78b4e8 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bca884940>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:43.788316 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b06bbb33-b4c9-42c6-9705-f7e78d78b4e8 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46" status: 200 len: 344 microversion: 2.1 time: 0.107149 Jun 03 13:21:43.788316 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 9/10] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:21:43 2022] GET /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 => generated 344 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:44.267040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-5eec99cc-10b3-4405-8479-cfadb98d804c tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] Calling method '.version_select at 0x7f5bca902310>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:44.319813 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-5eec99cc-10b3-4405-8479-cfadb98d804c tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2b54393f-ba89-4065-8795-f5d528f63673" status: 200 len: 351 microversion: 2.1 time: 0.061799 Jun 03 13:21:44.320671 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 2/11] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:21:44 2022] GET /compute/v2.1/os-volumes/2b54393f-ba89-4065-8795-f5d528f63673 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:44.802939 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9292f1f1-3c37-4967-b731-945a0bb23397 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bca902a60>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:44.813308 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-175822094", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "networks": [{"uuid": "55c65481-d498-4f43-80f2-8ef68be16fa6"}]}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:44.902485 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9292f1f1-3c37-4967-b731-945a0bb23397 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46" status: 200 len: 345 microversion: 2.1 time: 0.106076 Jun 03 13:21:44.909645 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 3/12] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:21:44 2022] GET /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:44.915651 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6a1c965b-cd46-4094-8ce4-3db19f5b5a2b tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Action: 'create', calling method: .version_select at 0x7f5bcaa34ee0>, body: {"snapshot": {"volume_id": "f39dbabd-f08a-4f6a-9db9-f8a4cb197a46", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-400167459"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:45.019058 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] validate_networks() for [('55c65481-d498-4f43-80f2-8ef68be16fa6', None, None, None, None, None)] {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:21:45.690554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6a1c965b-cd46-4094-8ce4-3db19f5b5a2b tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.779445 Jun 03 13:21:45.691425 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 4/13] 10.222.0.61 () {60 vars in 1161 bytes} [Fri Jun 3 13:21:44 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:45.716467 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0459083f-732f-4a0a-b70f-e2b2109cdc10 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bca895040>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:45.876646 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0459083f-732f-4a0a-b70f-e2b2109cdc10 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd" status: 200 len: 286 microversion: 2.1 time: 0.171647 Jun 03 13:21:45.878354 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 5/14] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 13:21:45 2022] GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd => generated 286 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:21:45.889044 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3172cea8-52da-4230-9d4d-7f7e611611be tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bca895700>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:45.946876 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3172cea8-52da-4230-9d4d-7f7e611611be tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.062231 Jun 03 13:21:45.949754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 6/15] 10.222.0.61 () {58 vars in 1139 bytes} [Fri Jun 3 13:21:45 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:21:45.963934 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8ea8284a-cb25-45a0-8e97-8557d6f8cc9d tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bca895820>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:46.018804 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8ea8284a-cb25-45a0-8e97-8557d6f8cc9d tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd" status: 200 len: 286 microversion: 2.1 time: 0.061347 Jun 03 13:21:46.019467 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 7/16] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 13:21:45 2022] GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:46.574497 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7e144aa3-6362-48ae-b32a-8fe6b5867d4d tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] Calling method '.version_select at 0x7f5bca8954c0>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:46.665541 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-7e144aa3-6362-48ae-b32a-8fe6b5867d4d tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/acdc0461-3223-4126-992c-0d284060c26f" status: 200 len: 351 microversion: 2.1 time: 0.108332 Jun 03 13:21:46.666822 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 8/17] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:21:46 2022] GET /compute/v2.1/os-volumes/acdc0461-3223-4126-992c-0d284060c26f => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:46.832859 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:21:46.833889 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:21:46.834548 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:21:46.835131 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:21:46.836277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:21:46.868107 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:46.869143 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:46.870459 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:46.871503 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:46.909956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Getting quotas for project f6909571f8274f4ebf822ce71cd43c2b. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:21:46.921543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Getting quotas for user 144789e582de45c280d03b92dee5692a and project f6909571f8274f4ebf822ce71cd43c2b. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:21:46.935706 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:21:46.940010 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:21:47.040138 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ee4580c9-7038-430b-b9ea-6f2b1aebe43e tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bca902e50>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:47.103169 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ee4580c9-7038-430b-b9ea-6f2b1aebe43e tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd" status: 200 len: 286 microversion: 2.1 time: 0.075925 Jun 03 13:21:47.104423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 9/18] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 13:21:47 2022] GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:47.157882 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6d3f845a-9462-4d13-9877-86b7f24a6c1d tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.481380 Jun 03 13:21:47.158617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 10/19] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:21:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:21:47.169575 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1b51ed1b-c500-4c5d-9a7e-d3e99ace4a59 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:47.174131 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-1b51ed1b-c500-4c5d-9a7e-d3e99ace4a59 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:47.397991 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-1b51ed1b-c500-4c5d-9a7e-d3e99ace4a59 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:47.431304 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-1b51ed1b-c500-4c5d-9a7e-d3e99ace4a59 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1214 microversion: 2.1 time: 0.265333 Jun 03 13:21:47.432877 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 10/20] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:47 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1214 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:48.121427 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e90b3464-2ea4-40a4-aa17-41cbb3273792 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bca7899d0>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:48.208078 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e90b3464-2ea4-40a4-aa17-41cbb3273792 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd" status: 200 len: 286 microversion: 2.1 time: 0.096654 Jun 03 13:21:48.208964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 11/21] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 13:21:48 2022] GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:48.454844 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-25980f70-e047-4481-8456-436e929234ca tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:48.454844 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-25980f70-e047-4481-8456-436e929234ca tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:48.723521 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-25980f70-e047-4481-8456-436e929234ca tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:48.736529 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-25980f70-e047-4481-8456-436e929234ca tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1214 microversion: 2.1 time: 0.291055 Jun 03 13:21:48.739187 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 11/22] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:48 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1214 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:49.221529 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-28b82184-1310-4e56-a846-39a2bceec333 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bc9f23160>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:49.282765 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-28b82184-1310-4e56-a846-39a2bceec333 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd" status: 200 len: 286 microversion: 2.1 time: 0.065991 Jun 03 13:21:49.283629 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 12/23] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 13:21:49 2022] GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:21:49.757512 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4199daca-cfb6-4593-80eb-a7921f756db2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:49.758733 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4199daca-cfb6-4593-80eb-a7921f756db2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:50.030169 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4199daca-cfb6-4593-80eb-a7921f756db2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:50.046740 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4199daca-cfb6-4593-80eb-a7921f756db2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1214 microversion: 2.1 time: 0.292766 Jun 03 13:21:50.052014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 12/24] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:49 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1214 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:50.298600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-327ea46f-bc23-4ac2-b795-b3c221c9ac5e tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bc9f23820>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:50.395672 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-327ea46f-bc23-4ac2-b795-b3c221c9ac5e tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd" status: 200 len: 286 microversion: 2.1 time: 0.104517 Jun 03 13:21:50.401542 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 13/25] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 13:21:50 2022] GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:51.064364 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d359373b-af11-4ecf-bf3c-f32fc9f3e1e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:51.065474 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d359373b-af11-4ecf-bf3c-f32fc9f3e1e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:51.087179 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d359373b-af11-4ecf-bf3c-f32fc9f3e1e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:51.088234 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d359373b-af11-4ecf-bf3c-f32fc9f3e1e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:51.088451 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d359373b-af11-4ecf-bf3c-f32fc9f3e1e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:51.089076 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d359373b-af11-4ecf-bf3c-f32fc9f3e1e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:51.409604 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b2048154-1361-4f6f-a5ae-658159c41aad tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bca789d30>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:51.465777 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b2048154-1361-4f6f-a5ae-658159c41aad tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd" status: 200 len: 286 microversion: 2.1 time: 0.060658 Jun 03 13:21:51.470701 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 14/26] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 13:21:51 2022] GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:51.602581 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d359373b-af11-4ecf-bf3c-f32fc9f3e1e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:51.619644 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d359373b-af11-4ecf-bf3c-f32fc9f3e1e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1218 microversion: 2.1 time: 0.559477 Jun 03 13:21:51.625061 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 13/27] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:51 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1218 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:52.479177 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d0a36dc7-52cd-4f68-9565-820ffbcd111f tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bca789820>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:52.549966 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d0a36dc7-52cd-4f68-9565-820ffbcd111f tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd" status: 200 len: 287 microversion: 2.1 time: 0.074876 Jun 03 13:21:52.550724 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 15/28] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 13:21:52 2022] GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:52.562764 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9ff999f5-552f-4af6-a3c0-a139b4ede91b tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bca7d69d0>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:52.643771 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-315a9e4a-06f2-41d1-9f24-95d90c2e4ef7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:52.647983 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-315a9e4a-06f2-41d1-9f24-95d90c2e4ef7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:52.680088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-315a9e4a-06f2-41d1-9f24-95d90c2e4ef7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:52.680569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-315a9e4a-06f2-41d1-9f24-95d90c2e4ef7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:52.682619 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-315a9e4a-06f2-41d1-9f24-95d90c2e4ef7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:52.688376 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-315a9e4a-06f2-41d1-9f24-95d90c2e4ef7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:52.799547 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9ff999f5-552f-4af6-a3c0-a139b4ede91b tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd" status: 202 len: 0 microversion: 2.1 time: 0.241780 Jun 03 13:21:52.800418 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 14/29] 10.222.0.61 () {58 vars in 1253 bytes} [Fri Jun 3 13:21:52 2022] DELETE /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:21:52.808364 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-21780809-2893-4ccb-965b-61c7ad5ba90e tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bca7de160>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:52.862066 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-21780809-2893-4ccb-965b-61c7ad5ba90e tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd" status: 200 len: 286 microversion: 2.1 time: 0.057438 Jun 03 13:21:52.863463 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 15/30] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 13:21:52 2022] GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:21:52.948286 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6576e475-c1bb-47a1-b96d-696ec5bd8efb tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] Calling method '.version_select at 0x7f5bca7d6b80>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:53.054605 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6576e475-c1bb-47a1-b96d-696ec5bd8efb tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6b15c121-3cf0-416c-b844-ce89cc43e93f" status: 200 len: 351 microversion: 2.1 time: 0.110150 Jun 03 13:21:53.055818 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 16/31] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:21:52 2022] GET /compute/v2.1/os-volumes/6b15c121-3cf0-416c-b844-ce89cc43e93f => generated 351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:53.068921 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-050c2916-3ec7-4a3a-b1dd-1ef4251d4322 tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] Calling method '.version_select at 0x7f5bca858040>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:53.237436 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-050c2916-3ec7-4a3a-b1dd-1ef4251d4322 tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.172589 Jun 03 13:21:53.238272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 17/32] 10.222.0.61 () {58 vars in 1133 bytes} [Fri Jun 3 13:21:53 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:53.251349 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a4c0450a-9857-4549-9f57-f2eb05115d1f tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] Calling method '.version_select at 0x7f5bca7de820>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:53.422775 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a4c0450a-9857-4549-9f57-f2eb05115d1f tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.175757 Jun 03 13:21:53.423445 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 18/33] 10.222.0.61 () {58 vars in 1148 bytes} [Fri Jun 3 13:21:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:21:53.426276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-315a9e4a-06f2-41d1-9f24-95d90c2e4ef7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:53.436532 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-582b0b18-becf-462e-b3f3-efc2fe92cc57 tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] Calling method '.version_select at 0x7f5bca7deb80>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:53.461307 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-315a9e4a-06f2-41d1-9f24-95d90c2e4ef7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1266 microversion: 2.1 time: 0.823910 Jun 03 13:21:53.463318 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 16/34] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:52 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1266 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:21:53.569266 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-582b0b18-becf-462e-b3f3-efc2fe92cc57 tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.135506 Jun 03 13:21:53.572535 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 19/35] 10.222.0.61 () {58 vars in 1133 bytes} [Fri Jun 3 13:21:53 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:53.589576 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2a217d77-f3b2-4b65-ae26-5a0ad12396d3 tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] Calling method '.version_select at 0x7f5bc96afb80>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:53.753808 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2a217d77-f3b2-4b65-ae26-5a0ad12396d3 tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.173472 Jun 03 13:21:53.754513 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 17/36] 10.222.0.61 () {58 vars in 1166 bytes} [Fri Jun 3 13:21:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:53.767543 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-cc37da52-2959-42e9-b393-7e9655de0519 tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] Calling method '.version_select at 0x7f5bca858040>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:53.876024 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4296bd9c-b8de-44e6-b509-6969aacedcc4 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bc96b89d0>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:53.985736 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-cc37da52-2959-42e9-b393-7e9655de0519 tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.222426 Jun 03 13:21:53.989621 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 20/37] 10.222.0.61 () {58 vars in 1169 bytes} [Fri Jun 3 13:21:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:54.000772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b8a69215-a994-49ec-8b73-52c0f740dd72 tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] Calling method '.version_select at 0x7f5bca7d6940>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:54.055400 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-4296bd9c-b8de-44e6-b509-6969aacedcc4 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] HTTP exception thrown: Snapshot cb5853c9-274d-4a66-927d-fa55a895e0cd could not be found. Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4296bd9c-b8de-44e6-b509-6969aacedcc4 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Request method failure captured: Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd HTTP/1.1 Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgrlffyhWomSBECNHwwj6Abo8VQygLuFOWkTwzQal0igo2ycYlzWnHDOuKmdS3A89ucoHFeWDGsoeFpv2ZwM_WmKcC_cIy_SIbf4efOVeJ-rt7kRWh-Qsis_ELR_JJJjos7FTyxX2CCAhx38E83FelMY1SwLuR_PoabpzFM9xo5lG6U Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: a7dd0495bb884e57b5fe98c3cb6ba7a9 Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-767724629 Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:21:54.070725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a7dd0495bb884e57b5fe98c3cb6ba7a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a7dd0495bb884e57b5fe98c3cb6ba7a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a7dd0495bb884e57b5fe98c3cb6ba7a9", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a7dd0495bb884e57b5fe98c3cb6ba7a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesSnapshotsTestJSON-767724629 Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: a7dd0495bb884e57b5fe98c3cb6ba7a9 Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-767724629 Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesSnapshotsTestJSON-767724629-project Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 74a2bbfe916a4f2f971c3ea952860988 Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesSnapshotsTestJSON-767724629-project Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Snapshot cb5853c9-274d-4a66-927d-fa55a895e0cd could not be found. Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': 'cb5853c9-274d-4a66-927d-fa55a895e0cd'} Jun 03 13:21:54.071847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cb5853c9-274d-4a66-927d-fa55a895e0cd could not be found. (HTTP 404) (Request-ID: req-cb6c41cf-1db4-4149-a799-55b289253ec9) Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:54.072572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:21:54.073705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cb5853c9-274d-4a66-927d-fa55a895e0cd could not be found. Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 03 13:21:54.075180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:21:54.078933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cb5853c9-274d-4a66-927d-fa55a895e0cd could not be found. Jun 03 13:21:54.078933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:54.078933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:54.078933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:54.078933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:54.078933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:54.078933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:54.078933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:21:54.078933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:21:54.078933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cb5853c9-274d-4a66-927d-fa55a895e0cd could not be found. Jun 03 13:21:54.078933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:54.089861 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4296bd9c-b8de-44e6-b509-6969aacedcc4 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Returning 404 to user: Snapshot cb5853c9-274d-4a66-927d-fa55a895e0cd could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:21:54.091775 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4296bd9c-b8de-44e6-b509-6969aacedcc4 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd" status: 404 len: 111 microversion: 2.1 time: 0.217145 Jun 03 13:21:54.100290 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 18/38] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 13:21:53 2022] GET /compute/v2.1/os-snapshots/cb5853c9-274d-4a66-927d-fa55a895e0cd => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:21:54.138198 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3e165692-9abe-465f-be08-f04214273f02 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bc96855e0>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:54.314428 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b8a69215-a994-49ec-8b73-52c0f740dd72 tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.319413 Jun 03 13:21:54.315005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 21/39] 10.222.0.61 () {58 vars in 1154 bytes} [Fri Jun 3 13:21:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:21:54.326901 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-53983c0c-94e3-42f6-93c3-b19e34bbc4ee tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] Calling method '.version_select at 0x7f5bca7ea8b0>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:54.589203 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3e165692-9abe-465f-be08-f04214273f02 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46" status: 202 len: 0 microversion: 2.1 time: 0.487240 Jun 03 13:21:54.590135 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 19/40] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 13:21:54 2022] DELETE /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:21:54.600183 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2f2c00f0-8fc7-43af-b6bb-be9d83798eb1 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:54.602826 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2f2c00f0-8fc7-43af-b6bb-be9d83798eb1 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:54.616549 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2f2c00f0-8fc7-43af-b6bb-be9d83798eb1 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:54.617612 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2f2c00f0-8fc7-43af-b6bb-be9d83798eb1 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:54.618787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2f2c00f0-8fc7-43af-b6bb-be9d83798eb1 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:54.619397 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2f2c00f0-8fc7-43af-b6bb-be9d83798eb1 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:54.742527 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-53983c0c-94e3-42f6-93c3-b19e34bbc4ee tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.419228 Jun 03 13:21:54.744179 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 22/41] 10.222.0.61 () {58 vars in 1187 bytes} [Fri Jun 3 13:21:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:54.750637 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8f5bc111-0cd7-47a9-afbd-b07eb095753b tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bca858040>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:54.855362 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2f2c00f0-8fc7-43af-b6bb-be9d83798eb1 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:54.868719 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2f2c00f0-8fc7-43af-b6bb-be9d83798eb1 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1272 microversion: 2.1 time: 0.277365 Jun 03 13:21:54.869653 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 20/42] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:54 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1272 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:54.881006 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8f5bc111-0cd7-47a9-afbd-b07eb095753b tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46" status: 200 len: 344 microversion: 2.1 time: 0.125970 Jun 03 13:21:54.881006 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 23/43] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:21:54 2022] GET /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 => generated 344 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:54.884756 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f9944747-ecab-419f-934c-917baaa97c82 tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] Calling method '.version_select at 0x7f5bca7de9d0>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:55.074251 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f9944747-ecab-419f-934c-917baaa97c82 tempest-VolumesTestJSON-397643430 tempest-VolumesTestJSON-397643430-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.195690 Jun 03 13:21:55.075306 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 24/44] 10.222.0.61 () {58 vars in 1154 bytes} [Fri Jun 3 13:21:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:55.823365 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-bebba575-be69-4f57-9c73-f6995e8df5df tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Action: 'create', calling method: .version_select at 0x7f5bc9685b80>, body: {"keypair": {"name": "tempest-keypair-462862448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBlOR7pYNmrV6Qo5HtwV/kfMF5ODb6sZHzBYjdEzwEt9xx7iPXlB9vvDhsA1zHNyDkeuDYsK9pygCCsLvrXTznzP3bftlIHMyz7G1uL8eYEwJcoHfKQCkyCKmVbtSY/ig=="}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:55.898753 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e5398c15-3348-4e31-b371-7c2bb78d4785 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bcb26e280>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:55.970900 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-bebba575-be69-4f57-9c73-f6995e8df5df tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Getting quotas for project 5a4dd3e8d45a4dee9be95d8326e00edf. Resources: {'key_pairs'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:21:56.000262 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-e5398c15-3348-4e31-b371-7c2bb78d4785 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] HTTP exception thrown: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e5398c15-3348-4e31-b371-7c2bb78d4785 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Request method failure captured: Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 HTTP/1.1 Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgrlffyhWomSBECNHwwj6Abo8VQygLuFOWkTwzQal0igo2ycYlzWnHDOuKmdS3A89ucoHFeWDGsoeFpv2ZwM_WmKcC_cIy_SIbf4efOVeJ-rt7kRWh-Qsis_ELR_JJJjos7FTyxX2CCAhx38E83FelMY1SwLuR_PoabpzFM9xo5lG6U Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: a7dd0495bb884e57b5fe98c3cb6ba7a9 Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-767724629 Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:21:56.006218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a7dd0495bb884e57b5fe98c3cb6ba7a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a7dd0495bb884e57b5fe98c3cb6ba7a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a7dd0495bb884e57b5fe98c3cb6ba7a9", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a7dd0495bb884e57b5fe98c3cb6ba7a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-VolumesSnapshotsTestJSON-767724629 Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: a7dd0495bb884e57b5fe98c3cb6ba7a9 Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-767724629 Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-VolumesSnapshotsTestJSON-767724629-project Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 74a2bbfe916a4f2f971c3ea952860988 Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-VolumesSnapshotsTestJSON-767724629-project Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': 'f39dbabd-f08a-4f6a-9db9-f8a4cb197a46'} Jun 03 13:21:56.009806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. (HTTP 404) (Request-ID: req-e2a4bb10-02e6-474d-bebc-8d787adbfb7f) Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:56.010423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:21:56.011282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 13:21:56.012272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e5398c15-3348-4e31-b371-7c2bb78d4785 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Returning 404 to user: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:21:56.014393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e5398c15-3348-4e31-b371-7c2bb78d4785 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46" status: 404 len: 109 microversion: 2.1 time: 0.123691 Jun 03 13:21:56.015506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-bebba575-be69-4f57-9c73-f6995e8df5df tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Getting quotas for user 7254adba100f4453b2b9a953990dbb41 and project 5a4dd3e8d45a4dee9be95d8326e00edf. Resources: {'key_pairs'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:21:56.016016 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 25/45] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:21:55 2022] GET /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:21:56.035168 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-37ba5c1a-bed9-4e8e-a556-080d14e631e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:56.035824 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-37ba5c1a-bed9-4e8e-a556-080d14e631e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:56.063374 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-37ba5c1a-bed9-4e8e-a556-080d14e631e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:56.067599 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-37ba5c1a-bed9-4e8e-a556-080d14e631e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:56.070064 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-37ba5c1a-bed9-4e8e-a556-080d14e631e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:56.077782 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-37ba5c1a-bed9-4e8e-a556-080d14e631e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:56.209314 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-bebba575-be69-4f57-9c73-f6995e8df5df tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.734692 Jun 03 13:21:56.210895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 21/46] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 13:21:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:56.223045 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-37359f72-75d9-4d81-9333-ba2f43a4c8f7 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bc96594c0>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:56.270528 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-37359f72-75d9-4d81-9333-ba2f43a4c8f7 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] HTTP exception thrown: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-37359f72-75d9-4d81-9333-ba2f43a4c8f7 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Request method failure captured: Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: DELETE /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 HTTP/1.1 Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgrlffyhWomSBECNHwwj6Abo8VQygLuFOWkTwzQal0igo2ycYlzWnHDOuKmdS3A89ucoHFeWDGsoeFpv2ZwM_WmKcC_cIy_SIbf4efOVeJ-rt7kRWh-Qsis_ELR_JJJjos7FTyxX2CCAhx38E83FelMY1SwLuR_PoabpzFM9xo5lG6U Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: a7dd0495bb884e57b5fe98c3cb6ba7a9 Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-767724629 Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:21:56.275523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a7dd0495bb884e57b5fe98c3cb6ba7a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a7dd0495bb884e57b5fe98c3cb6ba7a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a7dd0495bb884e57b5fe98c3cb6ba7a9", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a7dd0495bb884e57b5fe98c3cb6ba7a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesSnapshotsTestJSON-767724629 Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: a7dd0495bb884e57b5fe98c3cb6ba7a9 Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-767724629 Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesSnapshotsTestJSON-767724629-project Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 74a2bbfe916a4f2f971c3ea952860988 Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesSnapshotsTestJSON-767724629-project Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': 'f39dbabd-f08a-4f6a-9db9-f8a4cb197a46'} Jun 03 13:21:56.276642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. (HTTP 404) (Request-ID: req-057ee166-6bb5-4f25-856d-2018f20e2013) Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:56.277250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 13:21:56.278204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 13:21:56.280055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:21:56.282121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.282121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.282121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:56.282121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.282121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:56.282121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:56.282121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:56.282121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:21:56.282121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:21:56.282121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.282121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.287958 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-37359f72-75d9-4d81-9333-ba2f43a4c8f7 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Returning 404 to user: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:21:56.289843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-37359f72-75d9-4d81-9333-ba2f43a4c8f7 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46" status: 404 len: 109 microversion: 2.1 time: 0.077728 Jun 03 13:21:56.291059 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 22/47] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 13:21:56 2022] DELETE /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:21:56.310980 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7822ff43-929e-4a38-bf9b-e45084634510 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Calling method '.version_select at 0x7f5bc9685310>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:56.385391 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-7822ff43-929e-4a38-bf9b-e45084634510 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] HTTP exception thrown: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7822ff43-929e-4a38-bf9b-e45084634510 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Request method failure captured: Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 HTTP/1.1 Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgrlffyhWomSBECNHwwj6Abo8VQygLuFOWkTwzQal0igo2ycYlzWnHDOuKmdS3A89ucoHFeWDGsoeFpv2ZwM_WmKcC_cIy_SIbf4efOVeJ-rt7kRWh-Qsis_ELR_JJJjos7FTyxX2CCAhx38E83FelMY1SwLuR_PoabpzFM9xo5lG6U Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: a7dd0495bb884e57b5fe98c3cb6ba7a9 Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-767724629 Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:21:56.387480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a7dd0495bb884e57b5fe98c3cb6ba7a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a7dd0495bb884e57b5fe98c3cb6ba7a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a7dd0495bb884e57b5fe98c3cb6ba7a9", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a7dd0495bb884e57b5fe98c3cb6ba7a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesSnapshotsTestJSON-767724629 Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: a7dd0495bb884e57b5fe98c3cb6ba7a9 Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-767724629 Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesSnapshotsTestJSON-767724629-project Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 74a2bbfe916a4f2f971c3ea952860988 Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesSnapshotsTestJSON-767724629-project Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': 'f39dbabd-f08a-4f6a-9db9-f8a4cb197a46'} Jun 03 13:21:56.388600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. (HTTP 404) (Request-ID: req-b90ac832-c418-4755-8feb-b8486c16654f) Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:56.389429 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:21:56.390332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 13:21:56.391440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:21:56.393710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.393710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.393710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:56.393710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.393710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:56.393710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:56.393710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:56.393710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:21:56.393710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:21:56.393710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. Jun 03 13:21:56.393710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:21:56.396242 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7822ff43-929e-4a38-bf9b-e45084634510 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] Returning 404 to user: Volume f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:21:56.397301 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7822ff43-929e-4a38-bf9b-e45084634510 tempest-VolumesSnapshotsTestJSON-767724629 tempest-VolumesSnapshotsTestJSON-767724629-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46" status: 404 len: 109 microversion: 2.1 time: 0.099065 Jun 03 13:21:56.398339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 23/48] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:21:56 2022] GET /compute/v2.1/os-volumes/f39dbabd-f08a-4f6a-9db9-f8a4cb197a46 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:21:56.679317 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-37ba5c1a-bed9-4e8e-a556-080d14e631e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:56.709694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-37ba5c1a-bed9-4e8e-a556-080d14e631e5 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1272 microversion: 2.1 time: 0.685113 Jun 03 13:21:56.713702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 26/49] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:56 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1272 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:57.727465 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:57.735810 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-29c4b39c-49d7-451f-a1be-691b93214bda tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:57.738058 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-29c4b39c-49d7-451f-a1be-691b93214bda tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:57.766478 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-29c4b39c-49d7-451f-a1be-691b93214bda tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:57.767255 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-29c4b39c-49d7-451f-a1be-691b93214bda tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:57.773330 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-29c4b39c-49d7-451f-a1be-691b93214bda tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:57.775757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-29c4b39c-49d7-451f-a1be-691b93214bda tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:58.414121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-29c4b39c-49d7-451f-a1be-691b93214bda tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:58.432271 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-29c4b39c-49d7-451f-a1be-691b93214bda tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 0.704132 Jun 03 13:21:58.435400 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 24/50] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:57 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:59.455097 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-31271be7-460a-472c-9ade-473b25ae0593 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:59.455877 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-31271be7-460a-472c-9ade-473b25ae0593 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:59.470654 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-31271be7-460a-472c-9ade-473b25ae0593 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:59.471214 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-31271be7-460a-472c-9ade-473b25ae0593 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:59.472078 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-31271be7-460a-472c-9ade-473b25ae0593 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:59.482291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-31271be7-460a-472c-9ade-473b25ae0593 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:59.933793 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-31271be7-460a-472c-9ade-473b25ae0593 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:59.943002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-31271be7-460a-472c-9ade-473b25ae0593 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 0.491684 Jun 03 13:21:59.960299 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 27/51] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:59 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:00.335405 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5ab0d2f8-8161-4dd0-b207-9591d6100333 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Action: 'create', calling method: .version_select at 0x7f5bc9616af0>, body: {"keypair": {"name": "tempest-keypair-1524464403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfdO9U5VB6ALjaZTqjrGBE+sAXzfdyXyP3KPAE8fGcjbL9S/9dTagp3JkeAD+exoESFOqjk006mGJtGdcmc1gamihI1wNCCwcLK3DXbQgmK7261W++2ItS67nysILU82Q=="}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:00.373713 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-5ab0d2f8-8161-4dd0-b207-9591d6100333 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Getting quotas for project ab17731336f54a7eb5dfd954ddc8e688. Resources: {'key_pairs'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:22:00.385243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-5ab0d2f8-8161-4dd0-b207-9591d6100333 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Getting quotas for user 965645bc86f44cf38c5f571406722e32 and project ab17731336f54a7eb5dfd954ddc8e688. Resources: {'key_pairs'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:22:00.525952 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5ab0d2f8-8161-4dd0-b207-9591d6100333 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.570760 Jun 03 13:22:00.529927 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 25/52] 10.222.0.61 () {62 vars in 1199 bytes} [Fri Jun 3 13:21:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 576 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 13:22:00.848460 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=6 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:00.968166 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2469ea9c-45a6-40a7-9670-66a1e7151d84 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:00.969103 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2469ea9c-45a6-40a7-9670-66a1e7151d84 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:00.979243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2469ea9c-45a6-40a7-9670-66a1e7151d84 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:00.982344 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2469ea9c-45a6-40a7-9670-66a1e7151d84 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:00.982344 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2469ea9c-45a6-40a7-9670-66a1e7151d84 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:00.984968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2469ea9c-45a6-40a7-9670-66a1e7151d84 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:01.293420 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-166e63b7-5eb7-42d3-8176-77d9b2795875 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: .version_select at 0x7f5bca713d30>, body: {"keypair": {"name": "tempest-keypair-517165268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFPg/2+EZcjf255FarUTa9KSlkF/ZTYq5rwISYMFAJSWbVqZL5u5pSSqvzWZIR1aRs5SCsjAYxl0Wsf/MyiT07naWZMGEvyoNXNAWdjxuZBtHw4yqq1MQCVZC+DOAz5Jg=="}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:01.389160 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2469ea9c-45a6-40a7-9670-66a1e7151d84 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:01.407115 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2469ea9c-45a6-40a7-9670-66a1e7151d84 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 0.441994 Jun 03 13:22:01.409734 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 26/53] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:00 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:01.421557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-166e63b7-5eb7-42d3-8176-77d9b2795875 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'key_pairs'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:22:01.432686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-166e63b7-5eb7-42d3-8176-77d9b2795875 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for user 267a2b59a70245dfb7ec1b779f7fdd51 and project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'key_pairs'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:22:01.569925 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2090336846", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:01.659812 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-166e63b7-5eb7-42d3-8176-77d9b2795875 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.824039 Jun 03 13:22:01.661537 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 28/54] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 13:22:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:22:01.749894 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] validate_networks() for [('03b8c0d4-f175-4be9-832d-e4e605e93f1e', None, None, None, None, None)] {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:22:02.430565 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-2edea0f0-e31e-455d-afd2-28359337c390 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:02.432876 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-2edea0f0-e31e-455d-afd2-28359337c390 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:02.469410 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2edea0f0-e31e-455d-afd2-28359337c390 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:02.469410 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2edea0f0-e31e-455d-afd2-28359337c390 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:02.469410 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2edea0f0-e31e-455d-afd2-28359337c390 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:02.469410 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2edea0f0-e31e-455d-afd2-28359337c390 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:03.732236 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-2edea0f0-e31e-455d-afd2-28359337c390 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:03.751360 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-2edea0f0-e31e-455d-afd2-28359337c390 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 1.329880 Jun 03 13:22:03.755323 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 29/55] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:02 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:04.009094 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:22:04.012833 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:22:04.014127 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:22:04.014996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:22:04.015933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:22:04.034669 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:04.036647 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:04.038462 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:04.039410 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:04.063578 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Getting quotas for project 422fdba5c8474b93b285700c07e9304c. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:22:04.069047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Getting quotas for user 308bdbe63af5415d8e817bd9ba2fad3e and project 422fdba5c8474b93b285700c07e9304c. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:22:04.091171 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:22:04.094157 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:22:04.329139 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-613fef6c-f1b1-4d3d-9bfc-9f5d8cdab82a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.916184 Jun 03 13:22:04.333106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 27/56] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:22:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:22:04.344519 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-47df1f5e-285b-4a5e-a042-6aa407ececdd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:04.345916 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-47df1f5e-285b-4a5e-a042-6aa407ececdd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:04.692499 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-47df1f5e-285b-4a5e-a042-6aa407ececdd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:04.701743 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-47df1f5e-285b-4a5e-a042-6aa407ececdd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1222 microversion: 2.1 time: 0.361837 Jun 03 13:22:04.706342 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 30/57] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:04 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1222 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:04.770502 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-15bcda1e-6313-46e4-990e-80a37e54af92 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:04.771682 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-15bcda1e-6313-46e4-990e-80a37e54af92 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:04.786554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-15bcda1e-6313-46e4-990e-80a37e54af92 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:04.787017 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-15bcda1e-6313-46e4-990e-80a37e54af92 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:04.787874 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-15bcda1e-6313-46e4-990e-80a37e54af92 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:04.788241 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-15bcda1e-6313-46e4-990e-80a37e54af92 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:05.038991 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-756697233", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:05.290226 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.network.neutron [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] validate_networks() for [('03b8c0d4-f175-4be9-832d-e4e605e93f1e', None, None, None, None, None)] {{(pid=118178) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:22:06.521949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-15bcda1e-6313-46e4-990e-80a37e54af92 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:06.539770 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-15bcda1e-6313-46e4-990e-80a37e54af92 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 1.773202 Jun 03 13:22:06.549635 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 28/58] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:04 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:07.560092 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5efe390d-ce5b-40f6-956a-664e7bc0f4c6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:07.560752 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5efe390d-ce5b-40f6-956a-664e7bc0f4c6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:07.585908 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5efe390d-ce5b-40f6-956a-664e7bc0f4c6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:07.620277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5efe390d-ce5b-40f6-956a-664e7bc0f4c6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:07.633976 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5efe390d-ce5b-40f6-956a-664e7bc0f4c6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:07.633976 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5efe390d-ce5b-40f6-956a-664e7bc0f4c6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:09.053302 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5efe390d-ce5b-40f6-956a-664e7bc0f4c6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:09.071435 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5efe390d-ce5b-40f6-956a-664e7bc0f4c6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 1.516218 Jun 03 13:22:09.075711 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 29/59] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:07 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:09.091854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1605502157", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c0be2bd-39e0-439b-a4bd-28be0360d31a"}], "security_groups": [{"name": "tempest-securitygroup--1955489678"}], "key_name": "tempest-keypair-462862448", "user_data": "}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:09.643944 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] validate_networks() for [('3c0be2bd-39e0-439b-a4bd-28be0360d31a', None, None, None, None, None)] {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:22:09.995481 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Flavor limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:22:09.995973 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Image limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:22:09.996293 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Flavor pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:22:09.996874 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Image pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:22:10.021772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:22:10.021772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:10.021772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:10.021772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:10.022156 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:10.051701 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Getting quotas for project 422fdba5c8474b93b285700c07e9304c. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:22:10.056455 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Getting quotas for user 308bdbe63af5415d8e817bd9ba2fad3e and project 422fdba5c8474b93b285700c07e9304c. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:22:10.088225 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Going to run 1 instances... {{(pid=118178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:22:10.103798 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:22:10.380080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-edd5ad69-5126-4669-b137-0f2f5aacc523 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.346636 Jun 03 13:22:10.390716 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 31/60] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:22:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 5358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 13:22:10.403843 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-27137c0e-8758-447a-9eb3-0a44af6c807e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:10.407530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-27137c0e-8758-447a-9eb3-0a44af6c807e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:10.425362 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-27137c0e-8758-447a-9eb3-0a44af6c807e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:10.455447 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-27137c0e-8758-447a-9eb3-0a44af6c807e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:10.457127 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-27137c0e-8758-447a-9eb3-0a44af6c807e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:10.458217 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-27137c0e-8758-447a-9eb3-0a44af6c807e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:11.899496 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-27137c0e-8758-447a-9eb3-0a44af6c807e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:11.915978 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-27137c0e-8758-447a-9eb3-0a44af6c807e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 1.522439 Jun 03 13:22:11.917804 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 32/61] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:10 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:11.931656 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-62bb0324-6b64-4427-a182-5f84f6058445 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:11.934969 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-62bb0324-6b64-4427-a182-5f84f6058445 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:12.354227 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:22:12.354227 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:22:12.354227 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:22:12.354227 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:22:12.354227 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:22:12.354227 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=8 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:12.356169 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=21 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:12.356169 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:12.356169 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:12.356564 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-62bb0324-6b64-4427-a182-5f84f6058445 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:12.356671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:12.356671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:12.356835 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-62bb0324-6b64-4427-a182-5f84f6058445 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1221 microversion: 2.1 time: 0.397629 Jun 03 13:22:12.356835 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 33/62] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:11 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1221 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:12.356986 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=41 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:12.357120 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1620712991", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "933d7ba3-7582-451a-82dc-0b343d5ac36c"}], "security_groups": [{"name": "tempest-securitygroup--1730379941"}], "key_name": "tempest-keypair-517165268", "user_data": "}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:12.357230 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Getting quotas for project 5a4dd3e8d45a4dee9be95d8326e00edf. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:22:12.357230 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Getting quotas for user 7254adba100f4453b2b9a953990dbb41 and project 5a4dd3e8d45a4dee9be95d8326e00edf. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:22:12.410296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:22:12.420081 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:22:12.869073 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.network.neutron [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] validate_networks() for [('933d7ba3-7582-451a-82dc-0b343d5ac36c', None, None, None, None, None)] {{(pid=118178) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:22:13.041494 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9ab3fd77-3b6e-45e0-89b1-304664477651 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.955873 Jun 03 13:22:13.041494 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 30/63] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:22:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 3962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:22:13.048397 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1454091603", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "040a4fd6-75dc-4026-9586-7c7b1dfd5d98"}], "security_groups": [{"name": "tempest-securitygroup--1153761698"}], "key_name": "tempest-keypair-1524464403", "user_data": "}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:13.258042 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] validate_networks() for [('040a4fd6-75dc-4026-9586-7c7b1dfd5d98', None, None, None, None, None)] {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:22:13.689685 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:13.927772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Flavor limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:22:13.928311 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Image limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:22:13.928926 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Flavor pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:22:13.929345 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Image pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:22:13.929769 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:22:13.934671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:22:13.935164 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:22:13.935704 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:22:13.936844 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:22:13.937359 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:22:13.943013 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:13.943475 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:13.944313 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:13.944758 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:13.945775 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:13.946269 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:13.947091 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:13.947523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:13.952583 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=33 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:13.963499 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:22:13.964215 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Getting quotas for project ab17731336f54a7eb5dfd954ddc8e688. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:22:13.968099 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for user 267a2b59a70245dfb7ec1b779f7fdd51 and project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:22:13.968782 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Getting quotas for user 965645bc86f44cf38c5f571406722e32 and project ab17731336f54a7eb5dfd954ddc8e688. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:22:13.979442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Going to run 1 instances... {{(pid=118178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:22:13.979598 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:22:13.981779 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:22:13.982642 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:22:14.359149 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dfda5aab-6161-48bb-b16a-45c3b8c37b03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.036577 Jun 03 13:22:14.360383 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 34/64] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:22:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:22:14.378198 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-dc607623-112c-4b37-9174-6c26f89e8735 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.337736 Jun 03 13:22:14.380418 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 31/65] 10.222.0.61 () {62 vars in 1187 bytes} [Fri Jun 3 13:22:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 13:22:14.397324 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c9822b94-7e2a-41f4-9d8a-3d688e88cb6f tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:14.397978 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c9822b94-7e2a-41f4-9d8a-3d688e88cb6f tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:14.407492 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9822b94-7e2a-41f4-9d8a-3d688e88cb6f tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:14.407839 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9822b94-7e2a-41f4-9d8a-3d688e88cb6f tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:14.408851 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9822b94-7e2a-41f4-9d8a-3d688e88cb6f tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:14.409441 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9822b94-7e2a-41f4-9d8a-3d688e88cb6f tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:14.586318 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-2f299a5d-4e5c-423b-807a-4a17da93b32d req-014e2ce3-9695-428c-a458-d46c0a068e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec28c8c-6e08-42ec-ac43-6f502db967c0", "tag": "82a9c545-3bd3-4d02-8e78-ee2312428fcd"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:14.610840 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-2f299a5d-4e5c-423b-807a-4a17da93b32d req-014e2ce3-9695-428c-a458-d46c0a068e70 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:14.611436 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-2f299a5d-4e5c-423b-807a-4a17da93b32d req-014e2ce3-9695-428c-a458-d46c0a068e70 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:14.615398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c9822b94-7e2a-41f4-9d8a-3d688e88cb6f tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:14.627747 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c9822b94-7e2a-41f4-9d8a-3d688e88cb6f tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 0.240644 Jun 03 13:22:14.628838 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 32/66] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:14 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:14.636163 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9932f517-ef9f-45d0-8af1-f1a2e6451cdd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:14.655385 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9932f517-ef9f-45d0-8af1-f1a2e6451cdd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:14.681911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-2f299a5d-4e5c-423b-807a-4a17da93b32d req-014e2ce3-9695-428c-a458-d46c0a068e70 service nova] Creating event network-changed:82a9c545-3bd3-4d02-8e78-ee2312428fcd for instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 on hv-cinder-80135 Jun 03 13:22:14.681911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-2f299a5d-4e5c-423b-807a-4a17da93b32d req-014e2ce3-9695-428c-a458-d46c0a068e70 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118178) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 13:22:14.681911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-48495d87-1000-4e3e-94da-2c7fd6db80c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:14.681911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-48495d87-1000-4e3e-94da-2c7fd6db80c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:14.686158 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-48495d87-1000-4e3e-94da-2c7fd6db80c4 None None] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:14.686756 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-48495d87-1000-4e3e-94da-2c7fd6db80c4 None None] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:14.732530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.compute.rpcapi [None req-48495d87-1000-4e3e-94da-2c7fd6db80c4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 13:22:14.735082 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-48495d87-1000-4e3e-94da-2c7fd6db80c4 None None] Releasing lock "compute-rpcapi-router" {{(pid=118178) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 13:22:14.771174 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-48495d87-1000-4e3e-94da-2c7fd6db80c4 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.409040 Jun 03 13:22:14.777886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 35/67] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:22:14.785391 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f7ce5c57-9a0d-47d5-a706-1dcc0edae78a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:14.786499 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f7ce5c57-9a0d-47d5-a706-1dcc0edae78a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:14.803673 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f7ce5c57-9a0d-47d5-a706-1dcc0edae78a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:14.805059 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f7ce5c57-9a0d-47d5-a706-1dcc0edae78a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:14.806589 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f7ce5c57-9a0d-47d5-a706-1dcc0edae78a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:14.807331 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f7ce5c57-9a0d-47d5-a706-1dcc0edae78a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:14.860485 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9932f517-ef9f-45d0-8af1-f1a2e6451cdd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:14.894936 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9932f517-ef9f-45d0-8af1-f1a2e6451cdd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1237 microversion: 2.1 time: 0.264286 Jun 03 13:22:14.902180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 33/68] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:14 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1237 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:14.916860 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-baecb992-7b90-4bba-afb5-22393930b2b1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:14.917513 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-baecb992-7b90-4bba-afb5-22393930b2b1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:14.942137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f7ce5c57-9a0d-47d5-a706-1dcc0edae78a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:14.957422 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f7ce5c57-9a0d-47d5-a706-1dcc0edae78a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1217 microversion: 2.1 time: 0.177904 Jun 03 13:22:14.958073 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 36/69] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:14 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:14.992929 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-89cdd918-31cb-4b0f-b8bb-0cf71eef1295 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:14.995151 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-baecb992-7b90-4bba-afb5-22393930b2b1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:15.000359 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-89cdd918-31cb-4b0f-b8bb-0cf71eef1295 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:15.005139 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-baecb992-7b90-4bba-afb5-22393930b2b1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1241 microversion: 2.1 time: 0.097368 Jun 03 13:22:15.006206 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 34/70] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:14 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:15.126431 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-89cdd918-31cb-4b0f-b8bb-0cf71eef1295 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:15.133925 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-89cdd918-31cb-4b0f-b8bb-0cf71eef1295 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:15.136618 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-89cdd918-31cb-4b0f-b8bb-0cf71eef1295 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:15.136618 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-89cdd918-31cb-4b0f-b8bb-0cf71eef1295 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1282 microversion: 2.20 time: 0.177387 Jun 03 13:22:15.143852 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 37/71] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:14 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:15.647393 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7d871f85-3050-4693-9cdf-29735bae6c06 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:15.648073 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7d871f85-3050-4693-9cdf-29735bae6c06 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:15.656663 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7d871f85-3050-4693-9cdf-29735bae6c06 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:15.663347 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7d871f85-3050-4693-9cdf-29735bae6c06 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:15.663347 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7d871f85-3050-4693-9cdf-29735bae6c06 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:15.663347 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7d871f85-3050-4693-9cdf-29735bae6c06 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:15.929006 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ad9fa794-45c2-42f3-911b-fc60106b5b3c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:15.930833 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ad9fa794-45c2-42f3-911b-fc60106b5b3c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:15.962256 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ad9fa794-45c2-42f3-911b-fc60106b5b3c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:15.962986 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ad9fa794-45c2-42f3-911b-fc60106b5b3c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:15.966541 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ad9fa794-45c2-42f3-911b-fc60106b5b3c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:15.967212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ad9fa794-45c2-42f3-911b-fc60106b5b3c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:16.029641 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7d871f85-3050-4693-9cdf-29735bae6c06 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:16.038410 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7d871f85-3050-4693-9cdf-29735bae6c06 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 0.394670 Jun 03 13:22:16.039153 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 35/72] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:15 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:16.048612 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a07f30ac-2c02-4bc6-9e6b-73f727e19c73 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:16.049643 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a07f30ac-2c02-4bc6-9e6b-73f727e19c73 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:16.057965 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a07f30ac-2c02-4bc6-9e6b-73f727e19c73 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:16.058622 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a07f30ac-2c02-4bc6-9e6b-73f727e19c73 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:16.059618 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a07f30ac-2c02-4bc6-9e6b-73f727e19c73 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:16.060379 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a07f30ac-2c02-4bc6-9e6b-73f727e19c73 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:16.071091 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ad9fa794-45c2-42f3-911b-fc60106b5b3c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:16.094951 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ad9fa794-45c2-42f3-911b-fc60106b5b3c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1241 microversion: 2.1 time: 0.165160 Jun 03 13:22:16.094951 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 38/73] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:15 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1241 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:16.098017 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8e46cacd-ba89-4cd2-9c17-ea934def1697 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:16.108955 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8e46cacd-ba89-4cd2-9c17-ea934def1697 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:16.129604 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e46cacd-ba89-4cd2-9c17-ea934def1697 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:16.130176 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e46cacd-ba89-4cd2-9c17-ea934def1697 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:16.131299 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e46cacd-ba89-4cd2-9c17-ea934def1697 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:16.131933 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e46cacd-ba89-4cd2-9c17-ea934def1697 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:16.206039 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a07f30ac-2c02-4bc6-9e6b-73f727e19c73 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:16.215970 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a07f30ac-2c02-4bc6-9e6b-73f727e19c73 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1273 microversion: 2.1 time: 0.173998 Jun 03 13:22:16.216600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 36/74] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:16 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:16.222269 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ca1752b1-be20-4f64-bd87-19b3b6831d1f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:16.223060 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ca1752b1-be20-4f64-bd87-19b3b6831d1f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:16.234661 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ca1752b1-be20-4f64-bd87-19b3b6831d1f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:16.235569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ca1752b1-be20-4f64-bd87-19b3b6831d1f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:16.237430 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ca1752b1-be20-4f64-bd87-19b3b6831d1f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:16.237633 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8e46cacd-ba89-4cd2-9c17-ea934def1697 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:16.242657 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ca1752b1-be20-4f64-bd87-19b3b6831d1f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:16.257000 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8e46cacd-ba89-4cd2-9c17-ea934def1697 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1245 microversion: 2.1 time: 0.162792 Jun 03 13:22:16.257902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 39/75] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:16 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1245 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:16.325386 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ca1752b1-be20-4f64-bd87-19b3b6831d1f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:16.342645 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ca1752b1-be20-4f64-bd87-19b3b6831d1f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:16.344974 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ca1752b1-be20-4f64-bd87-19b3b6831d1f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:16.346340 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ca1752b1-be20-4f64-bd87-19b3b6831d1f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1286 microversion: 2.20 time: 0.128682 Jun 03 13:22:16.346996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 37/76] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:16 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:16.863936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-d0844bc1-09a9-40fa-8d6f-c15191f3b207 req-a18b0fe9-0d20-46f5-a83e-3afd75c941b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c52831-b2e0-4fb4-8aa7-6e99a89a3f08", "tag": "620412f0-e4fb-418a-adb1-ed5a33d57981"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:16.887914 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-d0844bc1-09a9-40fa-8d6f-c15191f3b207 req-a18b0fe9-0d20-46f5-a83e-3afd75c941b7 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:16.890519 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-d0844bc1-09a9-40fa-8d6f-c15191f3b207 req-a18b0fe9-0d20-46f5-a83e-3afd75c941b7 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:16.927342 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-d0844bc1-09a9-40fa-8d6f-c15191f3b207 req-a18b0fe9-0d20-46f5-a83e-3afd75c941b7 service nova] Creating event network-changed:620412f0-e4fb-418a-adb1-ed5a33d57981 for instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 on hv-cinder-80135 Jun 03 13:22:16.934246 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-d0844bc1-09a9-40fa-8d6f-c15191f3b207 req-a18b0fe9-0d20-46f5-a83e-3afd75c941b7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074749 Jun 03 13:22:16.935177 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 40/77] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:22:17.062654 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7fcf2086-6a63-4a64-be05-01a43f9237a7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:17.065700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7fcf2086-6a63-4a64-be05-01a43f9237a7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:17.075101 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7fcf2086-6a63-4a64-be05-01a43f9237a7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:17.075986 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7fcf2086-6a63-4a64-be05-01a43f9237a7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:17.078879 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7fcf2086-6a63-4a64-be05-01a43f9237a7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:17.080569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7fcf2086-6a63-4a64-be05-01a43f9237a7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:17.112803 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b20d3450-413d-452e-9960-ddc5a034be85 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:17.117571 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b20d3450-413d-452e-9960-ddc5a034be85 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:17.121201 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b20d3450-413d-452e-9960-ddc5a034be85 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:17.121769 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b20d3450-413d-452e-9960-ddc5a034be85 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:17.122813 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b20d3450-413d-452e-9960-ddc5a034be85 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:17.123465 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b20d3450-413d-452e-9960-ddc5a034be85 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:17.215057 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b20d3450-413d-452e-9960-ddc5a034be85 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:17.226134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b20d3450-413d-452e-9960-ddc5a034be85 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1241 microversion: 2.1 time: 0.119503 Jun 03 13:22:17.240384 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 41/78] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:17 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:17.245664 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b321192e-a56d-4a3a-9c95-e3a38a418cbc tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:17.247815 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b321192e-a56d-4a3a-9c95-e3a38a418cbc tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:17.261983 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b321192e-a56d-4a3a-9c95-e3a38a418cbc tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:17.270484 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b321192e-a56d-4a3a-9c95-e3a38a418cbc tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:17.271475 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b321192e-a56d-4a3a-9c95-e3a38a418cbc tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:17.272030 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b321192e-a56d-4a3a-9c95-e3a38a418cbc tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:17.342327 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7fcf2086-6a63-4a64-be05-01a43f9237a7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:17.350962 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7fcf2086-6a63-4a64-be05-01a43f9237a7 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 0.298593 Jun 03 13:22:17.351684 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 38/79] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:17 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:17.356812 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3b8d497f-3aeb-4e46-a785-a1116c161667 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:17.357555 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3b8d497f-3aeb-4e46-a785-a1116c161667 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:17.364416 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3b8d497f-3aeb-4e46-a785-a1116c161667 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:17.364923 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3b8d497f-3aeb-4e46-a785-a1116c161667 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:17.365831 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3b8d497f-3aeb-4e46-a785-a1116c161667 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:17.366125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3b8d497f-3aeb-4e46-a785-a1116c161667 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:17.370325 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b321192e-a56d-4a3a-9c95-e3a38a418cbc tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:17.378642 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b321192e-a56d-4a3a-9c95-e3a38a418cbc tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1273 microversion: 2.1 time: 0.137006 Jun 03 13:22:17.379577 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 42/80] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:17 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:17.394198 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-12781796-4f29-446b-b63b-f1447e75895b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:17.395028 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-12781796-4f29-446b-b63b-f1447e75895b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:17.401561 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-12781796-4f29-446b-b63b-f1447e75895b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:17.402338 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-12781796-4f29-446b-b63b-f1447e75895b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:17.403427 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-12781796-4f29-446b-b63b-f1447e75895b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:17.404197 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-12781796-4f29-446b-b63b-f1447e75895b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:17.454176 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3b8d497f-3aeb-4e46-a785-a1116c161667 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:17.461837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3b8d497f-3aeb-4e46-a785-a1116c161667 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1245 microversion: 2.1 time: 0.109046 Jun 03 13:22:17.462404 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 39/81] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:17 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:17.491092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-12781796-4f29-446b-b63b-f1447e75895b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:17.499533 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-12781796-4f29-446b-b63b-f1447e75895b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:17.501086 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-12781796-4f29-446b-b63b-f1447e75895b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:17.502426 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-12781796-4f29-446b-b63b-f1447e75895b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1286 microversion: 2.20 time: 0.121919 Jun 03 13:22:17.502986 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 43/82] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:17 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:18.247981 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a7923467-341e-4317-a48e-5bb938927db1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:18.249694 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a7923467-341e-4317-a48e-5bb938927db1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:18.276575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7923467-341e-4317-a48e-5bb938927db1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:18.277527 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7923467-341e-4317-a48e-5bb938927db1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:18.280569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7923467-341e-4317-a48e-5bb938927db1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:18.280956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7923467-341e-4317-a48e-5bb938927db1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:18.368104 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dc6e0cf2-33c2-4ab2-b1d5-9c817b50cea6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:18.369346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dc6e0cf2-33c2-4ab2-b1d5-9c817b50cea6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:18.380888 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dc6e0cf2-33c2-4ab2-b1d5-9c817b50cea6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:18.381341 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dc6e0cf2-33c2-4ab2-b1d5-9c817b50cea6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:18.382124 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dc6e0cf2-33c2-4ab2-b1d5-9c817b50cea6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:18.382566 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dc6e0cf2-33c2-4ab2-b1d5-9c817b50cea6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:18.452548 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a7923467-341e-4317-a48e-5bb938927db1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:18.462175 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a7923467-341e-4317-a48e-5bb938927db1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1241 microversion: 2.1 time: 0.218861 Jun 03 13:22:18.464482 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 40/83] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:18 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1241 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:18.472518 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8b60d96b-7350-4372-a935-6ba9a05211a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:18.474196 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8b60d96b-7350-4372-a935-6ba9a05211a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:18.481744 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8b60d96b-7350-4372-a935-6ba9a05211a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:18.482430 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8b60d96b-7350-4372-a935-6ba9a05211a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:18.484999 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8b60d96b-7350-4372-a935-6ba9a05211a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:18.485577 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8b60d96b-7350-4372-a935-6ba9a05211a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:18.586681 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8b60d96b-7350-4372-a935-6ba9a05211a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:18.595595 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8b60d96b-7350-4372-a935-6ba9a05211a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1273 microversion: 2.1 time: 0.129346 Jun 03 13:22:18.596460 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 41/84] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:18 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:18.601784 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-258d22c0-eb08-47bf-8526-35d8a31d7225 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:18.602451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-258d22c0-eb08-47bf-8526-35d8a31d7225 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:18.622534 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-258d22c0-eb08-47bf-8526-35d8a31d7225 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:18.622534 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-258d22c0-eb08-47bf-8526-35d8a31d7225 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:18.622534 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-258d22c0-eb08-47bf-8526-35d8a31d7225 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:18.622534 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-258d22c0-eb08-47bf-8526-35d8a31d7225 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:18.712538 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-258d22c0-eb08-47bf-8526-35d8a31d7225 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:18.722810 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-258d22c0-eb08-47bf-8526-35d8a31d7225 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1245 microversion: 2.1 time: 0.125112 Jun 03 13:22:18.723414 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 42/85] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:18 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1245 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:18.729030 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ad676c01-8fe5-4e22-b6dd-6eb62ebd7fb0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:18.730068 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ad676c01-8fe5-4e22-b6dd-6eb62ebd7fb0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:18.740036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ad676c01-8fe5-4e22-b6dd-6eb62ebd7fb0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:18.741024 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ad676c01-8fe5-4e22-b6dd-6eb62ebd7fb0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:18.741842 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ad676c01-8fe5-4e22-b6dd-6eb62ebd7fb0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:18.743289 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ad676c01-8fe5-4e22-b6dd-6eb62ebd7fb0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:18.902149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ad676c01-8fe5-4e22-b6dd-6eb62ebd7fb0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:18.913912 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ad676c01-8fe5-4e22-b6dd-6eb62ebd7fb0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:18.916087 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ad676c01-8fe5-4e22-b6dd-6eb62ebd7fb0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:18.918117 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ad676c01-8fe5-4e22-b6dd-6eb62ebd7fb0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1278 microversion: 2.20 time: 0.193414 Jun 03 13:22:18.919261 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 43/86] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:18 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:19.014070 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-dc6e0cf2-33c2-4ab2-b1d5-9c817b50cea6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:19.024359 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dc6e0cf2-33c2-4ab2-b1d5-9c817b50cea6 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 0.660097 Jun 03 13:22:19.025530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 44/87] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:18 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:19.483829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-259e70df-585d-4275-b6b6-d009ab3f398e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:19.485113 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-259e70df-585d-4275-b6b6-d009ab3f398e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:19.494442 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-259e70df-585d-4275-b6b6-d009ab3f398e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:19.495181 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-259e70df-585d-4275-b6b6-d009ab3f398e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:19.496251 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-259e70df-585d-4275-b6b6-d009ab3f398e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:19.497296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-259e70df-585d-4275-b6b6-d009ab3f398e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:19.590708 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-259e70df-585d-4275-b6b6-d009ab3f398e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:19.598492 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-259e70df-585d-4275-b6b6-d009ab3f398e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1289 microversion: 2.1 time: 0.118978 Jun 03 13:22:19.613854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7aea8c24-1bbc-48f6-aaa3-cb4efa0897e0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:19.614458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-7aea8c24-1bbc-48f6-aaa3-cb4efa0897e0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:19.616542 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 44/88] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:19 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1289 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:19.626292 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7aea8c24-1bbc-48f6-aaa3-cb4efa0897e0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:19.626746 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7aea8c24-1bbc-48f6-aaa3-cb4efa0897e0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:19.627523 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7aea8c24-1bbc-48f6-aaa3-cb4efa0897e0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:19.628016 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7aea8c24-1bbc-48f6-aaa3-cb4efa0897e0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:19.730421 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-7aea8c24-1bbc-48f6-aaa3-cb4efa0897e0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:19.741932 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8ecee927-849d-42a4-ac22-7e66a3f9e970 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:19.743952 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8ecee927-849d-42a4-ac22-7e66a3f9e970 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:19.747777 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-7aea8c24-1bbc-48f6-aaa3-cb4efa0897e0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1291 microversion: 2.1 time: 0.137043 Jun 03 13:22:19.751519 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 45/89] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:19 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1291 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:19.757161 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8ecee927-849d-42a4-ac22-7e66a3f9e970 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:19.760488 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8ecee927-849d-42a4-ac22-7e66a3f9e970 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:19.761717 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8ecee927-849d-42a4-ac22-7e66a3f9e970 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:19.762568 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8ecee927-849d-42a4-ac22-7e66a3f9e970 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:19.938281 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6824d208-ca0c-4480-a484-9628a9dd36d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:19.938946 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6824d208-ca0c-4480-a484-9628a9dd36d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:19.949592 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6824d208-ca0c-4480-a484-9628a9dd36d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:19.949980 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6824d208-ca0c-4480-a484-9628a9dd36d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:19.953373 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6824d208-ca0c-4480-a484-9628a9dd36d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:19.953999 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6824d208-ca0c-4480-a484-9628a9dd36d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:20.079122 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8ecee927-849d-42a4-ac22-7e66a3f9e970 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:20.110099 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8ecee927-849d-42a4-ac22-7e66a3f9e970 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1293 microversion: 2.1 time: 0.374608 Jun 03 13:22:20.114859 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 45/90] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:19 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1293 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:20.129392 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-493c9378-e336-4a90-b7ea-23d40f03b128 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:20.130516 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-493c9378-e336-4a90-b7ea-23d40f03b128 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:20.138425 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-493c9378-e336-4a90-b7ea-23d40f03b128 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:20.139000 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-493c9378-e336-4a90-b7ea-23d40f03b128 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:20.139966 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-493c9378-e336-4a90-b7ea-23d40f03b128 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:20.140513 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-493c9378-e336-4a90-b7ea-23d40f03b128 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:20.169136 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6824d208-ca0c-4480-a484-9628a9dd36d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:20.189229 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6824d208-ca0c-4480-a484-9628a9dd36d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:20.190953 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6824d208-ca0c-4480-a484-9628a9dd36d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:20.192207 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6824d208-ca0c-4480-a484-9628a9dd36d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1334 microversion: 2.20 time: 0.259287 Jun 03 13:22:20.202943 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 46/91] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:19 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1334 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:20.618096 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-fdaf02b7-391a-4541-bc99-cd78e54040ed tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:20.618723 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-fdaf02b7-391a-4541-bc99-cd78e54040ed tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:20.630294 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fdaf02b7-391a-4541-bc99-cd78e54040ed tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:20.630753 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fdaf02b7-391a-4541-bc99-cd78e54040ed tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:20.631528 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fdaf02b7-391a-4541-bc99-cd78e54040ed tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:20.631972 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fdaf02b7-391a-4541-bc99-cd78e54040ed tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:20.716432 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-fdaf02b7-391a-4541-bc99-cd78e54040ed tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:20.728122 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-fdaf02b7-391a-4541-bc99-cd78e54040ed tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1295 microversion: 2.1 time: 0.115508 Jun 03 13:22:20.731596 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 47/92] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:20 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1295 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:20.767851 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-266bd7b3-ed1a-48fd-af50-7e838d5d53d3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:20.768452 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-266bd7b3-ed1a-48fd-af50-7e838d5d53d3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:20.786183 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-266bd7b3-ed1a-48fd-af50-7e838d5d53d3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:20.786650 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-266bd7b3-ed1a-48fd-af50-7e838d5d53d3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:20.790638 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-266bd7b3-ed1a-48fd-af50-7e838d5d53d3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:20.791093 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-266bd7b3-ed1a-48fd-af50-7e838d5d53d3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:20.802723 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-493c9378-e336-4a90-b7ea-23d40f03b128 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:20.819724 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-493c9378-e336-4a90-b7ea-23d40f03b128 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 0.694318 Jun 03 13:22:20.820831 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 46/93] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:20 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:20.988488 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-266bd7b3-ed1a-48fd-af50-7e838d5d53d3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:21.004626 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-266bd7b3-ed1a-48fd-af50-7e838d5d53d3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1279 microversion: 2.1 time: 0.240683 Jun 03 13:22:21.006081 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 48/94] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:20 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1279 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:21.138034 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b93f0bc5-e213-4073-8c3f-5d1fe1503c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:21.139784 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b93f0bc5-e213-4073-8c3f-5d1fe1503c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:21.147148 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b93f0bc5-e213-4073-8c3f-5d1fe1503c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:21.147925 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b93f0bc5-e213-4073-8c3f-5d1fe1503c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:21.149321 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b93f0bc5-e213-4073-8c3f-5d1fe1503c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:21.150064 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b93f0bc5-e213-4073-8c3f-5d1fe1503c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:21.210844 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c5c7c16f-eb0e-4b81-9d7a-884fca517efa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:21.211772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-c5c7c16f-eb0e-4b81-9d7a-884fca517efa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:21.219911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c5c7c16f-eb0e-4b81-9d7a-884fca517efa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:21.220585 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c5c7c16f-eb0e-4b81-9d7a-884fca517efa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:21.221525 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c5c7c16f-eb0e-4b81-9d7a-884fca517efa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:21.222103 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c5c7c16f-eb0e-4b81-9d7a-884fca517efa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:21.312583 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b93f0bc5-e213-4073-8c3f-5d1fe1503c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:21.320839 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b93f0bc5-e213-4073-8c3f-5d1fe1503c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1299 microversion: 2.1 time: 0.186375 Jun 03 13:22:21.321958 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 47/95] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:21 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:21.330294 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c5c7c16f-eb0e-4b81-9d7a-884fca517efa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:21.342996 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c5c7c16f-eb0e-4b81-9d7a-884fca517efa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:21.345467 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c5c7c16f-eb0e-4b81-9d7a-884fca517efa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:21.347028 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c5c7c16f-eb0e-4b81-9d7a-884fca517efa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1340 microversion: 2.20 time: 0.140172 Jun 03 13:22:21.348693 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 49/96] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:21 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1340 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:21.760050 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-69499e12-b7d2-4700-bfc4-ad0e2983aa35 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:21.762369 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-69499e12-b7d2-4700-bfc4-ad0e2983aa35 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:21.770953 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-69499e12-b7d2-4700-bfc4-ad0e2983aa35 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:21.771630 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-69499e12-b7d2-4700-bfc4-ad0e2983aa35 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:21.772582 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-69499e12-b7d2-4700-bfc4-ad0e2983aa35 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:21.773159 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-69499e12-b7d2-4700-bfc4-ad0e2983aa35 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:21.839944 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a1e2b428-cc23-4437-9246-317d01cc2552 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:21.840601 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a1e2b428-cc23-4437-9246-317d01cc2552 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:21.856696 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a1e2b428-cc23-4437-9246-317d01cc2552 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:21.857164 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a1e2b428-cc23-4437-9246-317d01cc2552 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:21.861222 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a1e2b428-cc23-4437-9246-317d01cc2552 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:21.866471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a1e2b428-cc23-4437-9246-317d01cc2552 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:21.932218 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-69499e12-b7d2-4700-bfc4-ad0e2983aa35 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:21.951593 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-69499e12-b7d2-4700-bfc4-ad0e2983aa35 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1295 microversion: 2.1 time: 0.203224 Jun 03 13:22:21.952662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 48/97] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:21 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1295 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:22.021372 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-80258831-9975-4c70-8ff4-d26b6ff28a46 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:22.021937 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-80258831-9975-4c70-8ff4-d26b6ff28a46 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:22.029456 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-80258831-9975-4c70-8ff4-d26b6ff28a46 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:22.029456 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-80258831-9975-4c70-8ff4-d26b6ff28a46 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:22.030694 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-80258831-9975-4c70-8ff4-d26b6ff28a46 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:22.031307 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-80258831-9975-4c70-8ff4-d26b6ff28a46 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:22.265970 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-80258831-9975-4c70-8ff4-d26b6ff28a46 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:22.274251 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-80258831-9975-4c70-8ff4-d26b6ff28a46 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.256662 Jun 03 13:22:22.287758 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 49/98] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:22 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:22.343562 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7f484619-f3e2-4330-8585-877464946ed5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:22.346796 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7f484619-f3e2-4330-8585-877464946ed5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:22.353459 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7f484619-f3e2-4330-8585-877464946ed5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:22.354138 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7f484619-f3e2-4330-8585-877464946ed5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:22.355287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7f484619-f3e2-4330-8585-877464946ed5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:22.356081 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7f484619-f3e2-4330-8585-877464946ed5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:22.362724 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:22.450227 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a1e2b428-cc23-4437-9246-317d01cc2552 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:22.465360 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a1e2b428-cc23-4437-9246-317d01cc2552 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 0.631934 Jun 03 13:22:22.475799 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 50/99] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:21 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:22.487896 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-51d73f34-94fe-4e9e-9cd8-5d4fd0713b25 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:22.487896 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-51d73f34-94fe-4e9e-9cd8-5d4fd0713b25 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:22.488113 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7f484619-f3e2-4330-8585-877464946ed5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:22.488588 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-51d73f34-94fe-4e9e-9cd8-5d4fd0713b25 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:22.489309 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-51d73f34-94fe-4e9e-9cd8-5d4fd0713b25 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:22.490238 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-51d73f34-94fe-4e9e-9cd8-5d4fd0713b25 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:22.490827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-51d73f34-94fe-4e9e-9cd8-5d4fd0713b25 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:22.500500 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7f484619-f3e2-4330-8585-877464946ed5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1299 microversion: 2.1 time: 0.165695 Jun 03 13:22:22.512294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 50/100] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:22 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1299 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:22.962151 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-0671c20a-a1ef-47d8-9610-76f7401be46c req-8f108f7c-1a7f-4b7b-9990-9ceff8350e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec28c8c-6e08-42ec-ac43-6f502db967c0", "name": "network-vif-plugged", "status": "completed", "tag": "82a9c545-3bd3-4d02-8e78-ee2312428fcd"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:22.981663 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-0671c20a-a1ef-47d8-9610-76f7401be46c req-8f108f7c-1a7f-4b7b-9990-9ceff8350e63 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:22.982393 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-0671c20a-a1ef-47d8-9610-76f7401be46c req-8f108f7c-1a7f-4b7b-9990-9ceff8350e63 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:23.022097 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-0671c20a-a1ef-47d8-9610-76f7401be46c req-8f108f7c-1a7f-4b7b-9990-9ceff8350e63 service nova] Creating event network-vif-plugged:82a9c545-3bd3-4d02-8e78-ee2312428fcd for instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 on hv-cinder-80135 Jun 03 13:22:23.022842 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-0671c20a-a1ef-47d8-9610-76f7401be46c req-8f108f7c-1a7f-4b7b-9990-9ceff8350e63 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118179) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 13:22:23.024160 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4485c16-aea8-42b9-bcb5-f4a15ef305b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:23.024790 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4485c16-aea8-42b9-bcb5-f4a15ef305b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:23.025858 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4485c16-aea8-42b9-bcb5-f4a15ef305b2 None None] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:23.026584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4485c16-aea8-42b9-bcb5-f4a15ef305b2 None None] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:23.030741 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-51d73f34-94fe-4e9e-9cd8-5d4fd0713b25 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:23.040446 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-51d73f34-94fe-4e9e-9cd8-5d4fd0713b25 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:23.042225 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-51d73f34-94fe-4e9e-9cd8-5d4fd0713b25 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:23.043725 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-51d73f34-94fe-4e9e-9cd8-5d4fd0713b25 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.566224 Jun 03 13:22:23.047249 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.compute.rpcapi [None req-b4485c16-aea8-42b9-bcb5-f4a15ef305b2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 13:22:23.048390 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4485c16-aea8-42b9-bcb5-f4a15ef305b2 None None] Releasing lock "compute-rpcapi-router" {{(pid=118179) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 13:22:23.058448 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 51/101] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:22 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:23.066216 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6b8bba36-6b5c-4e13-8d2e-3c850684b27f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:23.066976 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6b8bba36-6b5c-4e13-8d2e-3c850684b27f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:23.072343 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b4485c16-aea8-42b9-bcb5-f4a15ef305b2 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.317792 Jun 03 13:22:23.073819 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6b8bba36-6b5c-4e13-8d2e-3c850684b27f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:23.073960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 51/102] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:22:23.074555 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6b8bba36-6b5c-4e13-8d2e-3c850684b27f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:23.075493 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6b8bba36-6b5c-4e13-8d2e-3c850684b27f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:23.076085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6b8bba36-6b5c-4e13-8d2e-3c850684b27f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:23.265089 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6b8bba36-6b5c-4e13-8d2e-3c850684b27f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:23.272944 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6b8bba36-6b5c-4e13-8d2e-3c850684b27f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.210661 Jun 03 13:22:23.273552 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 52/103] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:23 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:23.296748 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1e3c3c03-d6a2-4df0-b89b-7e6ee16262db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:23.297958 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-1e3c3c03-d6a2-4df0-b89b-7e6ee16262db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:23.306007 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1e3c3c03-d6a2-4df0-b89b-7e6ee16262db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:23.306452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1e3c3c03-d6a2-4df0-b89b-7e6ee16262db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:23.307211 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1e3c3c03-d6a2-4df0-b89b-7e6ee16262db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:23.307647 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1e3c3c03-d6a2-4df0-b89b-7e6ee16262db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:23.448557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1e3c3c03-d6a2-4df0-b89b-7e6ee16262db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:23.457296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1e3c3c03-d6a2-4df0-b89b-7e6ee16262db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.167116 Jun 03 13:22:23.458100 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 52/104] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:23 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:23.483455 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-73a319d3-cbe9-4a24-aed9-c0200acf8217 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:23.484487 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-73a319d3-cbe9-4a24-aed9-c0200acf8217 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:23.490582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-73a319d3-cbe9-4a24-aed9-c0200acf8217 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:23.491373 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-73a319d3-cbe9-4a24-aed9-c0200acf8217 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:23.492167 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-73a319d3-cbe9-4a24-aed9-c0200acf8217 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:23.492929 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-73a319d3-cbe9-4a24-aed9-c0200acf8217 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:23.509535 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=100 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:23.517512 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-331f2622-c3bb-4217-8e5b-3b6e2031f384 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:23.519835 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-331f2622-c3bb-4217-8e5b-3b6e2031f384 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:23.524861 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-331f2622-c3bb-4217-8e5b-3b6e2031f384 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:23.525315 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-331f2622-c3bb-4217-8e5b-3b6e2031f384 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:23.526083 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-331f2622-c3bb-4217-8e5b-3b6e2031f384 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:23.526585 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-331f2622-c3bb-4217-8e5b-3b6e2031f384 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:23.895548 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-73a319d3-cbe9-4a24-aed9-c0200acf8217 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:23.904493 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-73a319d3-cbe9-4a24-aed9-c0200acf8217 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 0.425317 Jun 03 13:22:23.906042 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 53/105] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:23 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:24.071176 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ecc99ec3-4086-4870-b493-3fa94671b87d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:24.080050 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ecc99ec3-4086-4870-b493-3fa94671b87d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:24.090443 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ecc99ec3-4086-4870-b493-3fa94671b87d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:24.092594 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ecc99ec3-4086-4870-b493-3fa94671b87d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:24.095534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ecc99ec3-4086-4870-b493-3fa94671b87d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:24.096400 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ecc99ec3-4086-4870-b493-3fa94671b87d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:24.120714 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-331f2622-c3bb-4217-8e5b-3b6e2031f384 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:24.135406 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-331f2622-c3bb-4217-8e5b-3b6e2031f384 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.621981 Jun 03 13:22:24.140987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 53/106] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:23 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:24.291418 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5733ba13-bff1-40ea-bf0f-d10f3ad033b4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:24.292381 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5733ba13-bff1-40ea-bf0f-d10f3ad033b4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:24.303108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5733ba13-bff1-40ea-bf0f-d10f3ad033b4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:24.307776 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5733ba13-bff1-40ea-bf0f-d10f3ad033b4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:24.307776 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5733ba13-bff1-40ea-bf0f-d10f3ad033b4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:24.307776 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5733ba13-bff1-40ea-bf0f-d10f3ad033b4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:24.562921 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ecc99ec3-4086-4870-b493-3fa94671b87d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:24.577580 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ecc99ec3-4086-4870-b493-3fa94671b87d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:24.587722 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ecc99ec3-4086-4870-b493-3fa94671b87d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:24.589306 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ecc99ec3-4086-4870-b493-3fa94671b87d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.522431 Jun 03 13:22:24.592721 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 54/107] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:24 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:24.603349 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-08026d90-b1f4-49b1-89b0-8e6f7f786564 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:24.603349 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-08026d90-b1f4-49b1-89b0-8e6f7f786564 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:24.619841 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-08026d90-b1f4-49b1-89b0-8e6f7f786564 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:24.620318 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-08026d90-b1f4-49b1-89b0-8e6f7f786564 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:24.621091 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-08026d90-b1f4-49b1-89b0-8e6f7f786564 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:24.621525 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-08026d90-b1f4-49b1-89b0-8e6f7f786564 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:24.729316 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=6 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:24.886245 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5733ba13-bff1-40ea-bf0f-d10f3ad033b4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:24.895864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5733ba13-bff1-40ea-bf0f-d10f3ad033b4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.609209 Jun 03 13:22:24.905850 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 54/108] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:24 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:24.923467 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7af890e0-b2fb-4e1f-9cd6-48069637aa90 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:24.924995 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7af890e0-b2fb-4e1f-9cd6-48069637aa90 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:24.934829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7af890e0-b2fb-4e1f-9cd6-48069637aa90 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:24.935523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7af890e0-b2fb-4e1f-9cd6-48069637aa90 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:24.937086 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7af890e0-b2fb-4e1f-9cd6-48069637aa90 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:24.937921 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7af890e0-b2fb-4e1f-9cd6-48069637aa90 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:24.967676 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-08026d90-b1f4-49b1-89b0-8e6f7f786564 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:24.996957 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-08026d90-b1f4-49b1-89b0-8e6f7f786564 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.400359 Jun 03 13:22:24.997604 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 55/109] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:24 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:25.008241 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=15 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:25.158977 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-da40cc5d-bd50-41ad-805e-866308d9f1f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:25.160466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-da40cc5d-bd50-41ad-805e-866308d9f1f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:25.163532 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=22 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:25.173182 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-da40cc5d-bd50-41ad-805e-866308d9f1f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:25.173696 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-da40cc5d-bd50-41ad-805e-866308d9f1f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:25.175907 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-da40cc5d-bd50-41ad-805e-866308d9f1f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:25.176446 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-da40cc5d-bd50-41ad-805e-866308d9f1f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:25.564541 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7af890e0-b2fb-4e1f-9cd6-48069637aa90 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:25.580931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7af890e0-b2fb-4e1f-9cd6-48069637aa90 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 0.659167 Jun 03 13:22:25.583047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 55/110] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:24 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:25.617269 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f517006d-a96e-4e41-b975-cbc0122fc8c3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:25.618830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f517006d-a96e-4e41-b975-cbc0122fc8c3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:25.660795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f517006d-a96e-4e41-b975-cbc0122fc8c3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:25.664474 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f517006d-a96e-4e41-b975-cbc0122fc8c3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:25.667872 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f517006d-a96e-4e41-b975-cbc0122fc8c3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:25.668409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f517006d-a96e-4e41-b975-cbc0122fc8c3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:25.906178 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-da40cc5d-bd50-41ad-805e-866308d9f1f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:25.914560 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-da40cc5d-bd50-41ad-805e-866308d9f1f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.760903 Jun 03 13:22:25.918843 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 56/111] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:25 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:25.927697 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-da68b074-3f7c-4429-b509-df23a525873e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:25.930394 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-da68b074-3f7c-4429-b509-df23a525873e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:25.943004 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-da68b074-3f7c-4429-b509-df23a525873e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:25.946289 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-da68b074-3f7c-4429-b509-df23a525873e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:25.947230 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-da68b074-3f7c-4429-b509-df23a525873e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:25.949678 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-da68b074-3f7c-4429-b509-df23a525873e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:26.564769 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-da68b074-3f7c-4429-b509-df23a525873e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:26.597208 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-da68b074-3f7c-4429-b509-df23a525873e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.677120 Jun 03 13:22:26.602328 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 57/112] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:25 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:26.614733 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a992d172-70f2-43c8-a8ba-26fcc8f88d2f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:26.615802 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a992d172-70f2-43c8-a8ba-26fcc8f88d2f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:26.635694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a992d172-70f2-43c8-a8ba-26fcc8f88d2f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:26.635694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a992d172-70f2-43c8-a8ba-26fcc8f88d2f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:26.635694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a992d172-70f2-43c8-a8ba-26fcc8f88d2f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:26.635694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a992d172-70f2-43c8-a8ba-26fcc8f88d2f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:26.720312 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f517006d-a96e-4e41-b975-cbc0122fc8c3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:26.750050 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f517006d-a96e-4e41-b975-cbc0122fc8c3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:26.755301 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f517006d-a96e-4e41-b975-cbc0122fc8c3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:26.760610 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f517006d-a96e-4e41-b975-cbc0122fc8c3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 1.151562 Jun 03 13:22:26.764735 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 56/113] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:25 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:26.777159 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-94a5d082-4ac3-4001-931e-73dd3a0162bd req-5deacb10-3e75-4ff7-9311-d9669c7fa993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a334af7a-c5bb-4c6e-aa37-bb7c86b838c2", "tag": "77ec7712-763e-4c88-ad78-1277b03066fd"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:26.799925 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-94a5d082-4ac3-4001-931e-73dd3a0162bd req-5deacb10-3e75-4ff7-9311-d9669c7fa993 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:26.802334 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-94a5d082-4ac3-4001-931e-73dd3a0162bd req-5deacb10-3e75-4ff7-9311-d9669c7fa993 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:26.828768 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-94a5d082-4ac3-4001-931e-73dd3a0162bd req-5deacb10-3e75-4ff7-9311-d9669c7fa993 service nova] Creating event network-changed:77ec7712-763e-4c88-ad78-1277b03066fd for instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 on hv-cinder-80135 Jun 03 13:22:26.838338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-94a5d082-4ac3-4001-931e-73dd3a0162bd req-5deacb10-3e75-4ff7-9311-d9669c7fa993 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072888 Jun 03 13:22:26.838940 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 57/114] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:22:26.859030 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6962684e-885f-4cd1-8806-66d739370633 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:26.859974 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6962684e-885f-4cd1-8806-66d739370633 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:26.876084 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6962684e-885f-4cd1-8806-66d739370633 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:26.876798 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6962684e-885f-4cd1-8806-66d739370633 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:26.878082 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6962684e-885f-4cd1-8806-66d739370633 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:26.878603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6962684e-885f-4cd1-8806-66d739370633 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:27.210135 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6962684e-885f-4cd1-8806-66d739370633 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:27.229276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6962684e-885f-4cd1-8806-66d739370633 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1314 microversion: 2.1 time: 0.388955 Jun 03 13:22:27.230684 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 58/115] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:26 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:27.264521 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a992d172-70f2-43c8-a8ba-26fcc8f88d2f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:27.271674 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a992d172-70f2-43c8-a8ba-26fcc8f88d2f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.667952 Jun 03 13:22:27.272777 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 58/116] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:26 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:27.280850 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d94e48d8-1d3d-4118-91ab-449a020160ad tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:27.280850 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d94e48d8-1d3d-4118-91ab-449a020160ad tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:27.286399 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d94e48d8-1d3d-4118-91ab-449a020160ad tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:27.288592 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d94e48d8-1d3d-4118-91ab-449a020160ad tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:27.289386 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d94e48d8-1d3d-4118-91ab-449a020160ad tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:27.289864 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d94e48d8-1d3d-4118-91ab-449a020160ad tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:27.404140 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-b54e51a1-37b5-42b3-9b3f-1148aed6cac4 req-2cc4a8e9-1a3e-44be-a4b6-6ec11bfacef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f119f5f-b6ed-45a0-a780-b1e037c96cc1", "tag": "14995843-d975-4a00-9ad9-746c61f720d5"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:27.415814 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-b54e51a1-37b5-42b3-9b3f-1148aed6cac4 req-2cc4a8e9-1a3e-44be-a4b6-6ec11bfacef6 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:27.423059 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-b54e51a1-37b5-42b3-9b3f-1148aed6cac4 req-2cc4a8e9-1a3e-44be-a4b6-6ec11bfacef6 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:27.435271 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-b54e51a1-37b5-42b3-9b3f-1148aed6cac4 req-2cc4a8e9-1a3e-44be-a4b6-6ec11bfacef6 service nova] Creating event network-changed:14995843-d975-4a00-9ad9-746c61f720d5 for instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 on hv-cinder-80135 Jun 03 13:22:27.441209 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-b54e51a1-37b5-42b3-9b3f-1148aed6cac4 req-2cc4a8e9-1a3e-44be-a4b6-6ec11bfacef6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209145 Jun 03 13:22:27.442402 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 59/117] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:22:27.588917 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d94e48d8-1d3d-4118-91ab-449a020160ad tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:27.596897 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d94e48d8-1d3d-4118-91ab-449a020160ad tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.322994 Jun 03 13:22:27.597478 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 59/118] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:27 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:27.618838 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-17810c82-de16-449a-8529-2259f67968d8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:27.619530 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-17810c82-de16-449a-8529-2259f67968d8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:27.628303 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-17810c82-de16-449a-8529-2259f67968d8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:27.628753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-17810c82-de16-449a-8529-2259f67968d8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:27.629722 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-17810c82-de16-449a-8529-2259f67968d8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:27.630350 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-17810c82-de16-449a-8529-2259f67968d8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:27.764018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-17810c82-de16-449a-8529-2259f67968d8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:27.772353 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-17810c82-de16-449a-8529-2259f67968d8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.157868 Jun 03 13:22:27.772978 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 60/119] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:27 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:27.778367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-575d9d11-dad1-4335-a536-dcfdb18b2613 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:27.778979 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-575d9d11-dad1-4335-a536-dcfdb18b2613 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:27.784959 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-575d9d11-dad1-4335-a536-dcfdb18b2613 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:27.785404 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-575d9d11-dad1-4335-a536-dcfdb18b2613 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:27.786155 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-575d9d11-dad1-4335-a536-dcfdb18b2613 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:27.786589 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-575d9d11-dad1-4335-a536-dcfdb18b2613 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:27.930007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-575d9d11-dad1-4335-a536-dcfdb18b2613 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:27.938795 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-575d9d11-dad1-4335-a536-dcfdb18b2613 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:27.940334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-575d9d11-dad1-4335-a536-dcfdb18b2613 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:27.941426 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-575d9d11-dad1-4335-a536-dcfdb18b2613 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.167091 Jun 03 13:22:27.941973 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 60/120] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:27 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:28.247248 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0827214c-efcb-4dac-be6c-2f3a566ddbc8 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:28.247863 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0827214c-efcb-4dac-be6c-2f3a566ddbc8 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:28.254821 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0827214c-efcb-4dac-be6c-2f3a566ddbc8 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:28.255272 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0827214c-efcb-4dac-be6c-2f3a566ddbc8 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:28.256026 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0827214c-efcb-4dac-be6c-2f3a566ddbc8 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:28.256490 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0827214c-efcb-4dac-be6c-2f3a566ddbc8 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:28.289308 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-22594bb1-b4e3-482a-ad07-61a97ba88869 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:28.290160 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-22594bb1-b4e3-482a-ad07-61a97ba88869 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:28.297709 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-22594bb1-b4e3-482a-ad07-61a97ba88869 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:28.298274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-22594bb1-b4e3-482a-ad07-61a97ba88869 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:28.299140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-22594bb1-b4e3-482a-ad07-61a97ba88869 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:28.299848 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-22594bb1-b4e3-482a-ad07-61a97ba88869 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:28.392844 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0827214c-efcb-4dac-be6c-2f3a566ddbc8 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:28.400591 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0827214c-efcb-4dac-be6c-2f3a566ddbc8 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1501 microversion: 2.1 time: 0.157186 Jun 03 13:22:28.401170 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 61/121] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:28 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:28.476981 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-22594bb1-b4e3-482a-ad07-61a97ba88869 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:28.487652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-22594bb1-b4e3-482a-ad07-61a97ba88869 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.202130 Jun 03 13:22:28.497915 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 61/122] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:28 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:28.613833 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a7c24092-1c48-4b11-b375-121c86a76cca tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:28.614441 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a7c24092-1c48-4b11-b375-121c86a76cca tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:28.620775 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7c24092-1c48-4b11-b375-121c86a76cca tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:28.621216 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7c24092-1c48-4b11-b375-121c86a76cca tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:28.623964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7c24092-1c48-4b11-b375-121c86a76cca tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:28.623964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7c24092-1c48-4b11-b375-121c86a76cca tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:28.789907 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-02447315-b769-4d91-b8a7-26e1f61809b9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:28.790541 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-02447315-b769-4d91-b8a7-26e1f61809b9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:28.797201 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-02447315-b769-4d91-b8a7-26e1f61809b9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:28.797653 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-02447315-b769-4d91-b8a7-26e1f61809b9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:28.798594 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-02447315-b769-4d91-b8a7-26e1f61809b9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:28.799025 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-02447315-b769-4d91-b8a7-26e1f61809b9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:28.826183 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a7c24092-1c48-4b11-b375-121c86a76cca tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:28.837432 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a7c24092-1c48-4b11-b375-121c86a76cca tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.227820 Jun 03 13:22:28.838188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 62/123] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:28 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:28.970387 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-23ec487a-e229-49a5-b1c5-0f273467f983 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:28.971046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-23ec487a-e229-49a5-b1c5-0f273467f983 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:28.985210 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-23ec487a-e229-49a5-b1c5-0f273467f983 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:28.985210 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-23ec487a-e229-49a5-b1c5-0f273467f983 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:28.985826 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-23ec487a-e229-49a5-b1c5-0f273467f983 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:28.987023 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-23ec487a-e229-49a5-b1c5-0f273467f983 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:29.010659 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-02447315-b769-4d91-b8a7-26e1f61809b9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:29.020282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-02447315-b769-4d91-b8a7-26e1f61809b9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.234116 Jun 03 13:22:29.021442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 62/124] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:28 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:29.157301 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-4c8d3fa0-ec60-45e1-b96d-eaee832dcbf2 req-6cab9a76-40a9-41e4-b7cf-47c98258173b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f916e17-eccc-4c6d-b3cd-9517056abcfc", "tag": "24f2a109-5081-4497-ba6a-88eaca5fa11c"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:29.167035 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-4c8d3fa0-ec60-45e1-b96d-eaee832dcbf2 req-6cab9a76-40a9-41e4-b7cf-47c98258173b service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:29.167756 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-4c8d3fa0-ec60-45e1-b96d-eaee832dcbf2 req-6cab9a76-40a9-41e4-b7cf-47c98258173b service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:29.181925 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-4c8d3fa0-ec60-45e1-b96d-eaee832dcbf2 req-6cab9a76-40a9-41e4-b7cf-47c98258173b service nova] Creating event network-changed:24f2a109-5081-4497-ba6a-88eaca5fa11c for instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc on hv-cinder-80135 Jun 03 13:22:29.187221 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-4c8d3fa0-ec60-45e1-b96d-eaee832dcbf2 req-6cab9a76-40a9-41e4-b7cf-47c98258173b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034428 Jun 03 13:22:29.188064 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 63/125] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:22:29.226527 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-23ec487a-e229-49a5-b1c5-0f273467f983 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:29.238095 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-23ec487a-e229-49a5-b1c5-0f273467f983 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:29.239823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-23ec487a-e229-49a5-b1c5-0f273467f983 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:29.241284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-23ec487a-e229-49a5-b1c5-0f273467f983 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.279115 Jun 03 13:22:29.242328 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 63/126] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:28 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:29.483666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-4e26b9eb-0bb1-4880-8dec-8895eec7d64e req-96b08814-0b30-4133-a0cc-525558955ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2968dd86-2754-4322-aae8-39fa37b9826f", "tag": "8e15e8ed-2b3b-4de4-b402-39e1c2a41fcd"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:29.492844 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-4e26b9eb-0bb1-4880-8dec-8895eec7d64e req-96b08814-0b30-4133-a0cc-525558955ddd service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:29.493291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-4e26b9eb-0bb1-4880-8dec-8895eec7d64e req-96b08814-0b30-4133-a0cc-525558955ddd service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:29.505300 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-baf1fbaa-b8a5-427c-80b3-af121b741825 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:29.505961 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-baf1fbaa-b8a5-427c-80b3-af121b741825 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:29.507116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-4e26b9eb-0bb1-4880-8dec-8895eec7d64e req-96b08814-0b30-4133-a0cc-525558955ddd service nova] Creating event network-changed:8e15e8ed-2b3b-4de4-b402-39e1c2a41fcd for instance 2968dd86-2754-4322-aae8-39fa37b9826f on hv-cinder-80135 Jun 03 13:22:29.507973 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:29.513393 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-baf1fbaa-b8a5-427c-80b3-af121b741825 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:29.514478 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-baf1fbaa-b8a5-427c-80b3-af121b741825 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:29.515411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-4e26b9eb-0bb1-4880-8dec-8895eec7d64e req-96b08814-0b30-4133-a0cc-525558955ddd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035497 Jun 03 13:22:29.515624 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-baf1fbaa-b8a5-427c-80b3-af121b741825 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:29.516666 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-baf1fbaa-b8a5-427c-80b3-af121b741825 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:29.517031 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 64/127] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:22:29.664216 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-baf1fbaa-b8a5-427c-80b3-af121b741825 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:29.672395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-baf1fbaa-b8a5-427c-80b3-af121b741825 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.171180 Jun 03 13:22:29.672997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 64/128] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:29 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:29.855764 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-842a0612-8a4f-4821-bcfe-18d637f9aa29 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:29.856473 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-842a0612-8a4f-4821-bcfe-18d637f9aa29 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:29.863630 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-842a0612-8a4f-4821-bcfe-18d637f9aa29 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:29.864270 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-842a0612-8a4f-4821-bcfe-18d637f9aa29 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:29.865452 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-842a0612-8a4f-4821-bcfe-18d637f9aa29 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:29.866048 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-842a0612-8a4f-4821-bcfe-18d637f9aa29 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:29.995864 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-842a0612-8a4f-4821-bcfe-18d637f9aa29 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:30.003763 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-842a0612-8a4f-4821-bcfe-18d637f9aa29 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.152156 Jun 03 13:22:30.004315 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 65/129] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:29 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:30.038590 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-14505b05-fda1-4f93-9701-807a96765271 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:30.039206 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-14505b05-fda1-4f93-9701-807a96765271 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:30.046160 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-14505b05-fda1-4f93-9701-807a96765271 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:30.046691 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-14505b05-fda1-4f93-9701-807a96765271 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:30.048714 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-14505b05-fda1-4f93-9701-807a96765271 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:30.049163 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-14505b05-fda1-4f93-9701-807a96765271 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:30.194235 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-14505b05-fda1-4f93-9701-807a96765271 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:30.202167 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-14505b05-fda1-4f93-9701-807a96765271 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.166769 Jun 03 13:22:30.202731 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 65/130] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:30 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:30.260219 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9a7fc04b-b353-4c06-81ce-3381a08ac461 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:30.260860 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-9a7fc04b-b353-4c06-81ce-3381a08ac461 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:30.267495 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9a7fc04b-b353-4c06-81ce-3381a08ac461 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:30.267947 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9a7fc04b-b353-4c06-81ce-3381a08ac461 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:30.268876 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9a7fc04b-b353-4c06-81ce-3381a08ac461 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:30.269212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9a7fc04b-b353-4c06-81ce-3381a08ac461 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:30.550261 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9a7fc04b-b353-4c06-81ce-3381a08ac461 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:30.558194 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9a7fc04b-b353-4c06-81ce-3381a08ac461 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:30.560359 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9a7fc04b-b353-4c06-81ce-3381a08ac461 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:30.562037 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9a7fc04b-b353-4c06-81ce-3381a08ac461 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.306040 Jun 03 13:22:30.562600 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 66/131] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:30 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:30.689775 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-31046446-cccc-4c6e-a1bf-59154b1a4231 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:30.690733 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-31046446-cccc-4c6e-a1bf-59154b1a4231 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:30.696994 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-31046446-cccc-4c6e-a1bf-59154b1a4231 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:30.697473 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-31046446-cccc-4c6e-a1bf-59154b1a4231 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:30.698213 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-31046446-cccc-4c6e-a1bf-59154b1a4231 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:30.698821 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-31046446-cccc-4c6e-a1bf-59154b1a4231 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:31.001771 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-31046446-cccc-4c6e-a1bf-59154b1a4231 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:31.010666 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-31046446-cccc-4c6e-a1bf-59154b1a4231 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.325228 Jun 03 13:22:31.021664 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 66/132] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:30 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:31.023302 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c09ed6a7-2f17-4d77-935e-ac1cf0a4e33d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:31.030440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-c09ed6a7-2f17-4d77-935e-ac1cf0a4e33d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:31.037196 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c09ed6a7-2f17-4d77-935e-ac1cf0a4e33d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:31.037854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c09ed6a7-2f17-4d77-935e-ac1cf0a4e33d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:31.038658 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c09ed6a7-2f17-4d77-935e-ac1cf0a4e33d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:31.039093 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c09ed6a7-2f17-4d77-935e-ac1cf0a4e33d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:31.219770 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4fc6c731-dcb6-4887-97d9-3d5ee0182265 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:31.221085 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4fc6c731-dcb6-4887-97d9-3d5ee0182265 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:31.228416 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4fc6c731-dcb6-4887-97d9-3d5ee0182265 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:31.229730 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4fc6c731-dcb6-4887-97d9-3d5ee0182265 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:31.231047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4fc6c731-dcb6-4887-97d9-3d5ee0182265 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:31.232071 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4fc6c731-dcb6-4887-97d9-3d5ee0182265 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:31.260097 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c09ed6a7-2f17-4d77-935e-ac1cf0a4e33d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:31.268992 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c09ed6a7-2f17-4d77-935e-ac1cf0a4e33d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.251514 Jun 03 13:22:31.270958 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 67/133] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:31 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:31.581606 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c482e681-67e4-40c5-9785-5004d3b8de95 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:31.582599 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-c482e681-67e4-40c5-9785-5004d3b8de95 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:31.590670 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c482e681-67e4-40c5-9785-5004d3b8de95 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:31.591302 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c482e681-67e4-40c5-9785-5004d3b8de95 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:31.593080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c482e681-67e4-40c5-9785-5004d3b8de95 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:31.593683 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c482e681-67e4-40c5-9785-5004d3b8de95 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:31.629537 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4fc6c731-dcb6-4887-97d9-3d5ee0182265 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:31.637885 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4fc6c731-dcb6-4887-97d9-3d5ee0182265 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.422774 Jun 03 13:22:31.649286 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 67/134] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:31 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:31.823695 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-39abadd8-dcba-4bbe-8ea7-11fa258220b7 req-eff1b092-028c-4815-85ca-500cca8690c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c52831-b2e0-4fb4-8aa7-6e99a89a3f08", "name": "network-vif-plugged", "status": "completed", "tag": "620412f0-e4fb-418a-adb1-ed5a33d57981"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:31.841587 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c482e681-67e4-40c5-9785-5004d3b8de95 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:31.843930 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-39abadd8-dcba-4bbe-8ea7-11fa258220b7 req-eff1b092-028c-4815-85ca-500cca8690c2 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:31.844908 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-39abadd8-dcba-4bbe-8ea7-11fa258220b7 req-eff1b092-028c-4815-85ca-500cca8690c2 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:31.854328 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c482e681-67e4-40c5-9785-5004d3b8de95 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:31.855882 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c482e681-67e4-40c5-9785-5004d3b8de95 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:31.857241 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c482e681-67e4-40c5-9785-5004d3b8de95 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.281971 Jun 03 13:22:31.863951 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 68/135] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:31 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:31.864076 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-39abadd8-dcba-4bbe-8ea7-11fa258220b7 req-eff1b092-028c-4815-85ca-500cca8690c2 service nova] Creating event network-vif-plugged:620412f0-e4fb-418a-adb1-ed5a33d57981 for instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 on hv-cinder-80135 Jun 03 13:22:31.865251 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-39abadd8-dcba-4bbe-8ea7-11fa258220b7 req-eff1b092-028c-4815-85ca-500cca8690c2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045508 Jun 03 13:22:31.865828 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 68/136] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:22:32.028686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4ee08d21-1eaf-49eb-a679-c0354d47ad7b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:32.029278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4ee08d21-1eaf-49eb-a679-c0354d47ad7b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:32.035874 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ee08d21-1eaf-49eb-a679-c0354d47ad7b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:32.036389 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ee08d21-1eaf-49eb-a679-c0354d47ad7b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:32.037160 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ee08d21-1eaf-49eb-a679-c0354d47ad7b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:32.037597 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ee08d21-1eaf-49eb-a679-c0354d47ad7b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:32.187389 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4ee08d21-1eaf-49eb-a679-c0354d47ad7b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:32.195936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4ee08d21-1eaf-49eb-a679-c0354d47ad7b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.171214 Jun 03 13:22:32.196544 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 69/137] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:32 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:32.286296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ce8192d1-3620-4eaf-92f3-e228083a910d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:32.286956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ce8192d1-3620-4eaf-92f3-e228083a910d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:32.293095 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ce8192d1-3620-4eaf-92f3-e228083a910d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:32.293541 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ce8192d1-3620-4eaf-92f3-e228083a910d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:32.294291 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ce8192d1-3620-4eaf-92f3-e228083a910d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:32.294731 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ce8192d1-3620-4eaf-92f3-e228083a910d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:32.299781 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:32.434921 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ce8192d1-3620-4eaf-92f3-e228083a910d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:32.443260 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ce8192d1-3620-4eaf-92f3-e228083a910d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.161177 Jun 03 13:22:32.443823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 69/138] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:32 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:32.453229 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-271221ab-1fbd-48fc-a961-d9cdb7540b59 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83c97482-5a17-48d4-b5db-7037f6d2f776"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:32.454366 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-271221ab-1fbd-48fc-a961-d9cdb7540b59 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:32.460586 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-271221ab-1fbd-48fc-a961-d9cdb7540b59 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:32.461120 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-271221ab-1fbd-48fc-a961-d9cdb7540b59 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:32.461914 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-271221ab-1fbd-48fc-a961-d9cdb7540b59 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:32.462488 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-271221ab-1fbd-48fc-a961-d9cdb7540b59 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:32.656069 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3609c64f-a715-4978-9891-70a305c91185 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:32.656908 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3609c64f-a715-4978-9891-70a305c91185 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:32.662984 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3609c64f-a715-4978-9891-70a305c91185 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:32.663587 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3609c64f-a715-4978-9891-70a305c91185 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:32.664311 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3609c64f-a715-4978-9891-70a305c91185 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:32.664753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3609c64f-a715-4978-9891-70a305c91185 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:32.793859 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3609c64f-a715-4978-9891-70a305c91185 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:32.801911 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3609c64f-a715-4978-9891-70a305c91185 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.150326 Jun 03 13:22:32.802467 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 70/139] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:32 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:32.876601 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6c4ca43b-338c-43ed-be25-509715c0fae7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:32.877272 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6c4ca43b-338c-43ed-be25-509715c0fae7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:32.887026 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6c4ca43b-338c-43ed-be25-509715c0fae7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:32.887026 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6c4ca43b-338c-43ed-be25-509715c0fae7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:32.887026 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6c4ca43b-338c-43ed-be25-509715c0fae7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:32.887026 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6c4ca43b-338c-43ed-be25-509715c0fae7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:33.019638 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6c4ca43b-338c-43ed-be25-509715c0fae7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:33.027856 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6c4ca43b-338c-43ed-be25-509715c0fae7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:33.029408 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6c4ca43b-338c-43ed-be25-509715c0fae7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:33.031069 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6c4ca43b-338c-43ed-be25-509715c0fae7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.159231 Jun 03 13:22:33.031636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 71/140] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:32 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:33.212905 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-bfe66fcc-8f21-4746-aac6-36346a12a8e6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:33.213700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-bfe66fcc-8f21-4746-aac6-36346a12a8e6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:33.215543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=8 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:33.220914 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bfe66fcc-8f21-4746-aac6-36346a12a8e6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:33.221427 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bfe66fcc-8f21-4746-aac6-36346a12a8e6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:33.222198 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bfe66fcc-8f21-4746-aac6-36346a12a8e6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:33.222638 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bfe66fcc-8f21-4746-aac6-36346a12a8e6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:33.354903 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-bfe66fcc-8f21-4746-aac6-36346a12a8e6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:33.362860 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-bfe66fcc-8f21-4746-aac6-36346a12a8e6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.154099 Jun 03 13:22:33.363931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 72/141] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:33 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:33.461170 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a8cecd36-a791-46d1-bbea-dfa6369730cb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:33.461779 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a8cecd36-a791-46d1-bbea-dfa6369730cb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:33.468477 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a8cecd36-a791-46d1-bbea-dfa6369730cb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:33.468926 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a8cecd36-a791-46d1-bbea-dfa6369730cb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:33.469683 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a8cecd36-a791-46d1-bbea-dfa6369730cb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:33.470118 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a8cecd36-a791-46d1-bbea-dfa6369730cb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:33.601280 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a8cecd36-a791-46d1-bbea-dfa6369730cb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:33.609411 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a8cecd36-a791-46d1-bbea-dfa6369730cb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.152228 Jun 03 13:22:33.610001 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 73/142] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:33 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:33.818982 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-512e539f-31dc-44f2-bc17-76fb8bf976d1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:33.819627 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-512e539f-31dc-44f2-bc17-76fb8bf976d1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:33.825843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-512e539f-31dc-44f2-bc17-76fb8bf976d1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:33.826974 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-512e539f-31dc-44f2-bc17-76fb8bf976d1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:33.827769 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-512e539f-31dc-44f2-bc17-76fb8bf976d1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:33.828250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-512e539f-31dc-44f2-bc17-76fb8bf976d1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:33.957804 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-512e539f-31dc-44f2-bc17-76fb8bf976d1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:33.965328 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-512e539f-31dc-44f2-bc17-76fb8bf976d1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.150105 Jun 03 13:22:33.965894 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 74/143] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:33 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:34.048947 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-34c5bb9c-2954-46d0-b136-e4d6cd5cf30f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:34.049549 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-34c5bb9c-2954-46d0-b136-e4d6cd5cf30f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:34.055379 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-34c5bb9c-2954-46d0-b136-e4d6cd5cf30f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:34.055816 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-34c5bb9c-2954-46d0-b136-e4d6cd5cf30f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:34.056600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-34c5bb9c-2954-46d0-b136-e4d6cd5cf30f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:34.057028 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-34c5bb9c-2954-46d0-b136-e4d6cd5cf30f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:34.191464 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-34c5bb9c-2954-46d0-b136-e4d6cd5cf30f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:34.199723 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-34c5bb9c-2954-46d0-b136-e4d6cd5cf30f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:34.201360 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-34c5bb9c-2954-46d0-b136-e4d6cd5cf30f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:34.206416 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-34c5bb9c-2954-46d0-b136-e4d6cd5cf30f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.158166 Jun 03 13:22:34.206416 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 75/144] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:34 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:34.380285 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a7e18126-f72f-4e95-bcca-e2384f26af55 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:34.380979 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a7e18126-f72f-4e95-bcca-e2384f26af55 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:34.387028 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7e18126-f72f-4e95-bcca-e2384f26af55 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:34.387472 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7e18126-f72f-4e95-bcca-e2384f26af55 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:34.388258 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7e18126-f72f-4e95-bcca-e2384f26af55 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:34.388691 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7e18126-f72f-4e95-bcca-e2384f26af55 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:34.523063 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a7e18126-f72f-4e95-bcca-e2384f26af55 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:34.531672 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a7e18126-f72f-4e95-bcca-e2384f26af55 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.154933 Jun 03 13:22:34.541400 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 76/145] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:34 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:34.626909 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ac7f10f0-e575-45e4-adc8-0b961f3f3be3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:34.627523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ac7f10f0-e575-45e4-adc8-0b961f3f3be3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:34.633648 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac7f10f0-e575-45e4-adc8-0b961f3f3be3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:34.634099 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac7f10f0-e575-45e4-adc8-0b961f3f3be3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:34.634860 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac7f10f0-e575-45e4-adc8-0b961f3f3be3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:34.635296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac7f10f0-e575-45e4-adc8-0b961f3f3be3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:34.766324 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ac7f10f0-e575-45e4-adc8-0b961f3f3be3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:34.774011 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ac7f10f0-e575-45e4-adc8-0b961f3f3be3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.151658 Jun 03 13:22:34.774641 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 77/146] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:34 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:34.982940 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0ddbbcce-a0c8-48ac-894f-b1d845a4ff09 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:34.983779 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0ddbbcce-a0c8-48ac-894f-b1d845a4ff09 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:35.002197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0ddbbcce-a0c8-48ac-894f-b1d845a4ff09 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:35.006684 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0ddbbcce-a0c8-48ac-894f-b1d845a4ff09 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:35.009355 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0ddbbcce-a0c8-48ac-894f-b1d845a4ff09 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:35.009355 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0ddbbcce-a0c8-48ac-894f-b1d845a4ff09 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:35.195993 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0ddbbcce-a0c8-48ac-894f-b1d845a4ff09 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:35.204371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0ddbbcce-a0c8-48ac-894f-b1d845a4ff09 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.225237 Jun 03 13:22:35.204993 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 78/147] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:34 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:35.220867 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-99b9f681-2101-46bb-b9a4-5608ba17fd1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:35.221628 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-99b9f681-2101-46bb-b9a4-5608ba17fd1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:35.227509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-99b9f681-2101-46bb-b9a4-5608ba17fd1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:35.228030 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-99b9f681-2101-46bb-b9a4-5608ba17fd1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:35.228814 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-99b9f681-2101-46bb-b9a4-5608ba17fd1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:35.229247 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-99b9f681-2101-46bb-b9a4-5608ba17fd1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:35.383337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-99b9f681-2101-46bb-b9a4-5608ba17fd1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:35.393159 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-99b9f681-2101-46bb-b9a4-5608ba17fd1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:35.394918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-99b9f681-2101-46bb-b9a4-5608ba17fd1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:35.396104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-99b9f681-2101-46bb-b9a4-5608ba17fd1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.179563 Jun 03 13:22:35.396770 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 79/148] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:35 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:35.549395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f3822474-d149-4377-8334-109f149ad8f0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:35.550056 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f3822474-d149-4377-8334-109f149ad8f0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:35.555992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f3822474-d149-4377-8334-109f149ad8f0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:35.556479 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f3822474-d149-4377-8334-109f149ad8f0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:35.557229 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f3822474-d149-4377-8334-109f149ad8f0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:35.557660 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f3822474-d149-4377-8334-109f149ad8f0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:35.691991 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f3822474-d149-4377-8334-109f149ad8f0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:35.699861 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f3822474-d149-4377-8334-109f149ad8f0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.154939 Jun 03 13:22:35.700460 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 80/149] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:35 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:35.790690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b91738c8-e5ec-4a00-aa63-c4609255b46a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:35.791294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b91738c8-e5ec-4a00-aa63-c4609255b46a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:35.798258 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b91738c8-e5ec-4a00-aa63-c4609255b46a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:35.798715 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b91738c8-e5ec-4a00-aa63-c4609255b46a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:35.799466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b91738c8-e5ec-4a00-aa63-c4609255b46a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:35.799898 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b91738c8-e5ec-4a00-aa63-c4609255b46a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:35.940761 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b91738c8-e5ec-4a00-aa63-c4609255b46a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:35.944281 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b91738c8-e5ec-4a00-aa63-c4609255b46a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.157325 Jun 03 13:22:35.944889 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 81/150] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:35 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:36.222344 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-32e50360-db69-411a-b6c8-78610f95283b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:36.225613 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-32e50360-db69-411a-b6c8-78610f95283b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:36.229742 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-32e50360-db69-411a-b6c8-78610f95283b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:36.230233 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-32e50360-db69-411a-b6c8-78610f95283b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:36.230980 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-32e50360-db69-411a-b6c8-78610f95283b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:36.231417 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-32e50360-db69-411a-b6c8-78610f95283b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:36.366290 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-32e50360-db69-411a-b6c8-78610f95283b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:36.374020 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-32e50360-db69-411a-b6c8-78610f95283b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.156331 Jun 03 13:22:36.374658 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 82/151] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:36 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:36.414466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-50e7af48-7109-4419-9592-1bb7cb9156e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:36.415081 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-50e7af48-7109-4419-9592-1bb7cb9156e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:36.421038 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-50e7af48-7109-4419-9592-1bb7cb9156e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:36.421597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-50e7af48-7109-4419-9592-1bb7cb9156e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:36.422356 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-50e7af48-7109-4419-9592-1bb7cb9156e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:36.422793 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-50e7af48-7109-4419-9592-1bb7cb9156e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:36.558002 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-50e7af48-7109-4419-9592-1bb7cb9156e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:36.566590 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-50e7af48-7109-4419-9592-1bb7cb9156e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:36.568083 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-50e7af48-7109-4419-9592-1bb7cb9156e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:36.569204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-50e7af48-7109-4419-9592-1bb7cb9156e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.158497 Jun 03 13:22:36.569752 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 83/152] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:36 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:36.716126 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-55f2e283-7a45-4641-97dd-b6e4704634bd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:36.716761 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-55f2e283-7a45-4641-97dd-b6e4704634bd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:36.722824 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-55f2e283-7a45-4641-97dd-b6e4704634bd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:36.725068 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-55f2e283-7a45-4641-97dd-b6e4704634bd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:36.725068 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-55f2e283-7a45-4641-97dd-b6e4704634bd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:36.725068 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-55f2e283-7a45-4641-97dd-b6e4704634bd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:36.853567 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-55f2e283-7a45-4641-97dd-b6e4704634bd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:36.862550 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-55f2e283-7a45-4641-97dd-b6e4704634bd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.150187 Jun 03 13:22:36.863186 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 84/153] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:36 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:36.960870 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1701cd4b-6dc4-49e3-bf66-cfb5976ad329 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:36.961481 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-1701cd4b-6dc4-49e3-bf66-cfb5976ad329 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:36.967728 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1701cd4b-6dc4-49e3-bf66-cfb5976ad329 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:36.968287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1701cd4b-6dc4-49e3-bf66-cfb5976ad329 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:36.969062 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1701cd4b-6dc4-49e3-bf66-cfb5976ad329 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:36.969498 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1701cd4b-6dc4-49e3-bf66-cfb5976ad329 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:37.106038 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1701cd4b-6dc4-49e3-bf66-cfb5976ad329 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:37.108745 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:37.114488 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1701cd4b-6dc4-49e3-bf66-cfb5976ad329 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.157457 Jun 03 13:22:37.115054 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 85/154] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:36 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:37.391893 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-25874797-21a1-4730-9d95-aa857f373157 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:37.392837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-25874797-21a1-4730-9d95-aa857f373157 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:37.401198 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-25874797-21a1-4730-9d95-aa857f373157 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:37.401834 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-25874797-21a1-4730-9d95-aa857f373157 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:37.402863 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-25874797-21a1-4730-9d95-aa857f373157 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:37.403411 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-25874797-21a1-4730-9d95-aa857f373157 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:37.557255 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-25874797-21a1-4730-9d95-aa857f373157 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:37.566150 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-25874797-21a1-4730-9d95-aa857f373157 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.179249 Jun 03 13:22:37.566815 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 86/155] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:37 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:37.586628 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d6ea2701-53fd-4357-a477-9aa84ce0b43d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:37.587243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d6ea2701-53fd-4357-a477-9aa84ce0b43d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:37.593527 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6ea2701-53fd-4357-a477-9aa84ce0b43d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:37.593983 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6ea2701-53fd-4357-a477-9aa84ce0b43d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:37.594749 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6ea2701-53fd-4357-a477-9aa84ce0b43d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:37.595219 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6ea2701-53fd-4357-a477-9aa84ce0b43d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:37.730936 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d6ea2701-53fd-4357-a477-9aa84ce0b43d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:37.740239 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d6ea2701-53fd-4357-a477-9aa84ce0b43d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:37.741746 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d6ea2701-53fd-4357-a477-9aa84ce0b43d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:37.744279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d6ea2701-53fd-4357-a477-9aa84ce0b43d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.160035 Jun 03 13:22:37.744279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 87/156] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:37 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:37.879494 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-20b5710c-e185-4904-be4c-c9e7beaec6d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:37.880105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-20b5710c-e185-4904-be4c-c9e7beaec6d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:37.886027 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-20b5710c-e185-4904-be4c-c9e7beaec6d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:37.886479 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-20b5710c-e185-4904-be4c-c9e7beaec6d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:37.887234 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-20b5710c-e185-4904-be4c-c9e7beaec6d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:37.887668 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-20b5710c-e185-4904-be4c-c9e7beaec6d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:38.042466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-20b5710c-e185-4904-be4c-c9e7beaec6d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:38.051230 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-20b5710c-e185-4904-be4c-c9e7beaec6d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.175454 Jun 03 13:22:38.053809 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 88/157] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:37 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:38.133265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-aa62bd66-9894-4713-bb28-f7fd4b8a4df0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:38.134338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-aa62bd66-9894-4713-bb28-f7fd4b8a4df0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:38.140623 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aa62bd66-9894-4713-bb28-f7fd4b8a4df0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:38.141075 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aa62bd66-9894-4713-bb28-f7fd4b8a4df0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:38.141833 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aa62bd66-9894-4713-bb28-f7fd4b8a4df0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:38.142300 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aa62bd66-9894-4713-bb28-f7fd4b8a4df0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:38.288004 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-aa62bd66-9894-4713-bb28-f7fd4b8a4df0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:38.295539 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-aa62bd66-9894-4713-bb28-f7fd4b8a4df0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.167245 Jun 03 13:22:38.296493 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 89/158] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:38 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:38.584054 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-284d6f8d-9ead-48ed-b53e-e195e519a7c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:38.584741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-284d6f8d-9ead-48ed-b53e-e195e519a7c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:38.596452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-284d6f8d-9ead-48ed-b53e-e195e519a7c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:38.596911 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-284d6f8d-9ead-48ed-b53e-e195e519a7c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:38.597831 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-284d6f8d-9ead-48ed-b53e-e195e519a7c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:38.598191 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-284d6f8d-9ead-48ed-b53e-e195e519a7c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:38.734254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-284d6f8d-9ead-48ed-b53e-e195e519a7c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:38.741712 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-284d6f8d-9ead-48ed-b53e-e195e519a7c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.161846 Jun 03 13:22:38.742208 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 90/159] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:38 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:38.761225 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3a2de479-c751-4582-8888-4cdba9bd4cc1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:38.761812 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3a2de479-c751-4582-8888-4cdba9bd4cc1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:38.768424 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3a2de479-c751-4582-8888-4cdba9bd4cc1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:38.768898 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3a2de479-c751-4582-8888-4cdba9bd4cc1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:38.769687 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3a2de479-c751-4582-8888-4cdba9bd4cc1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:38.770156 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3a2de479-c751-4582-8888-4cdba9bd4cc1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:38.911128 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3a2de479-c751-4582-8888-4cdba9bd4cc1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:38.920259 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3a2de479-c751-4582-8888-4cdba9bd4cc1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:38.920888 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3a2de479-c751-4582-8888-4cdba9bd4cc1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:38.922044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3a2de479-c751-4582-8888-4cdba9bd4cc1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.164586 Jun 03 13:22:38.925450 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 91/160] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:38 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:39.068905 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-afa060ef-0404-4efc-a061-b37bbcf77073 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:39.069518 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-afa060ef-0404-4efc-a061-b37bbcf77073 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:39.075457 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-afa060ef-0404-4efc-a061-b37bbcf77073 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:39.075867 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-afa060ef-0404-4efc-a061-b37bbcf77073 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:39.082008 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-afa060ef-0404-4efc-a061-b37bbcf77073 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:39.082008 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-afa060ef-0404-4efc-a061-b37bbcf77073 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:39.214735 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-afa060ef-0404-4efc-a061-b37bbcf77073 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:39.223392 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-afa060ef-0404-4efc-a061-b37bbcf77073 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.158204 Jun 03 13:22:39.224104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 92/161] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:39 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:39.311896 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5ddea239-f6ed-4e7e-b80c-b426f6864729 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:39.312629 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5ddea239-f6ed-4e7e-b80c-b426f6864729 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:39.318712 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ddea239-f6ed-4e7e-b80c-b426f6864729 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:39.319186 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ddea239-f6ed-4e7e-b80c-b426f6864729 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:39.319949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ddea239-f6ed-4e7e-b80c-b426f6864729 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:39.320509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ddea239-f6ed-4e7e-b80c-b426f6864729 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:39.458877 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5ddea239-f6ed-4e7e-b80c-b426f6864729 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:39.468041 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5ddea239-f6ed-4e7e-b80c-b426f6864729 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.160061 Jun 03 13:22:39.469069 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 93/162] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:39 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:39.763504 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d4a54cf2-b1ce-4dc1-98f9-5344dccd5b0b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:39.764919 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d4a54cf2-b1ce-4dc1-98f9-5344dccd5b0b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:39.771904 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d4a54cf2-b1ce-4dc1-98f9-5344dccd5b0b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:39.772868 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d4a54cf2-b1ce-4dc1-98f9-5344dccd5b0b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:39.773645 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d4a54cf2-b1ce-4dc1-98f9-5344dccd5b0b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:39.776280 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d4a54cf2-b1ce-4dc1-98f9-5344dccd5b0b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:39.906276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d4a54cf2-b1ce-4dc1-98f9-5344dccd5b0b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:39.913722 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d4a54cf2-b1ce-4dc1-98f9-5344dccd5b0b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.154183 Jun 03 13:22:39.914280 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 94/163] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:39 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:39.939233 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c8dcb37f-3ca3-4f39-bb8c-49935670ebf9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:39.939838 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c8dcb37f-3ca3-4f39-bb8c-49935670ebf9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:39.945917 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c8dcb37f-3ca3-4f39-bb8c-49935670ebf9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:39.947349 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c8dcb37f-3ca3-4f39-bb8c-49935670ebf9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:39.947349 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c8dcb37f-3ca3-4f39-bb8c-49935670ebf9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:39.947647 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c8dcb37f-3ca3-4f39-bb8c-49935670ebf9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:40.083117 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c8dcb37f-3ca3-4f39-bb8c-49935670ebf9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:40.091834 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c8dcb37f-3ca3-4f39-bb8c-49935670ebf9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:40.094463 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c8dcb37f-3ca3-4f39-bb8c-49935670ebf9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:40.100321 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c8dcb37f-3ca3-4f39-bb8c-49935670ebf9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.160220 Jun 03 13:22:40.100321 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 95/164] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:39 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:40.241626 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4118e850-7d38-4900-a2be-55b553992a1f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:40.242445 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4118e850-7d38-4900-a2be-55b553992a1f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:40.250332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4118e850-7d38-4900-a2be-55b553992a1f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:40.252392 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4118e850-7d38-4900-a2be-55b553992a1f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:40.252392 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4118e850-7d38-4900-a2be-55b553992a1f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:40.252392 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4118e850-7d38-4900-a2be-55b553992a1f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:40.409990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4118e850-7d38-4900-a2be-55b553992a1f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:40.418858 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4118e850-7d38-4900-a2be-55b553992a1f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.181008 Jun 03 13:22:40.419616 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 96/165] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:40 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:40.484967 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ada7411a-7335-47e4-8e63-8cb646a87106 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:40.485588 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ada7411a-7335-47e4-8e63-8cb646a87106 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:40.491566 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ada7411a-7335-47e4-8e63-8cb646a87106 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:40.492033 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ada7411a-7335-47e4-8e63-8cb646a87106 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:40.493126 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ada7411a-7335-47e4-8e63-8cb646a87106 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:40.493548 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ada7411a-7335-47e4-8e63-8cb646a87106 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:40.622700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ada7411a-7335-47e4-8e63-8cb646a87106 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:40.633443 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ada7411a-7335-47e4-8e63-8cb646a87106 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.153387 Jun 03 13:22:40.634185 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 97/166] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:40 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:40.930741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-08923184-7bf4-4bca-af27-63729295d69e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:40.931379 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-08923184-7bf4-4bca-af27-63729295d69e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:40.938129 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-08923184-7bf4-4bca-af27-63729295d69e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:40.938580 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-08923184-7bf4-4bca-af27-63729295d69e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:40.939337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-08923184-7bf4-4bca-af27-63729295d69e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:40.939774 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-08923184-7bf4-4bca-af27-63729295d69e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:41.066424 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-08923184-7bf4-4bca-af27-63729295d69e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:41.073802 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-08923184-7bf4-4bca-af27-63729295d69e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.147078 Jun 03 13:22:41.074388 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 98/167] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:40 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:41.113403 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-fa749c3a-9a4e-4ec6-90bb-2885c570b8d1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:41.114026 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-fa749c3a-9a4e-4ec6-90bb-2885c570b8d1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:41.120119 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fa749c3a-9a4e-4ec6-90bb-2885c570b8d1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:41.120591 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fa749c3a-9a4e-4ec6-90bb-2885c570b8d1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:41.121338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fa749c3a-9a4e-4ec6-90bb-2885c570b8d1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:41.121765 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fa749c3a-9a4e-4ec6-90bb-2885c570b8d1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:41.261009 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fa749c3a-9a4e-4ec6-90bb-2885c570b8d1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:41.271397 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fa749c3a-9a4e-4ec6-90bb-2885c570b8d1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:41.273129 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fa749c3a-9a4e-4ec6-90bb-2885c570b8d1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:41.274378 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-fa749c3a-9a4e-4ec6-90bb-2885c570b8d1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.164798 Jun 03 13:22:41.274956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 99/168] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:41 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:41.436484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6738d648-a57c-4174-8a55-3787494637de tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:41.437789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6738d648-a57c-4174-8a55-3787494637de tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:41.443889 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6738d648-a57c-4174-8a55-3787494637de tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:41.444379 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6738d648-a57c-4174-8a55-3787494637de tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:41.445140 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6738d648-a57c-4174-8a55-3787494637de tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:41.445579 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6738d648-a57c-4174-8a55-3787494637de tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:41.577121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6738d648-a57c-4174-8a55-3787494637de tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:41.584963 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6738d648-a57c-4174-8a55-3787494637de tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.152721 Jun 03 13:22:41.585516 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 100/169] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:41 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:41.652668 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-74cc0b38-7cc6-4a36-bcbd-4fb532481710 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:41.653365 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-74cc0b38-7cc6-4a36-bcbd-4fb532481710 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:41.660240 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-74cc0b38-7cc6-4a36-bcbd-4fb532481710 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:41.660688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-74cc0b38-7cc6-4a36-bcbd-4fb532481710 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:41.661445 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-74cc0b38-7cc6-4a36-bcbd-4fb532481710 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:41.661872 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-74cc0b38-7cc6-4a36-bcbd-4fb532481710 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:41.791789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-74cc0b38-7cc6-4a36-bcbd-4fb532481710 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:41.800131 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-74cc0b38-7cc6-4a36-bcbd-4fb532481710 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.151270 Jun 03 13:22:41.801017 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 101/170] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:41 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:41.810070 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-2aea3663-9327-4406-b779-00ebdb1bd49d req-8e244955-84a7-4590-ad09-84a92aec2ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f119f5f-b6ed-45a0-a780-b1e037c96cc1", "name": "network-vif-plugged", "status": "completed", "tag": "14995843-d975-4a00-9ad9-746c61f720d5"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:41.815746 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-2aea3663-9327-4406-b779-00ebdb1bd49d req-8e244955-84a7-4590-ad09-84a92aec2ce6 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:41.816291 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-2aea3663-9327-4406-b779-00ebdb1bd49d req-8e244955-84a7-4590-ad09-84a92aec2ce6 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:41.827723 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-2aea3663-9327-4406-b779-00ebdb1bd49d req-8e244955-84a7-4590-ad09-84a92aec2ce6 service nova] Creating event network-vif-plugged:14995843-d975-4a00-9ad9-746c61f720d5 for instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 on hv-cinder-80135 Jun 03 13:22:41.833015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-2aea3663-9327-4406-b779-00ebdb1bd49d req-8e244955-84a7-4590-ad09-84a92aec2ce6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030981 Jun 03 13:22:41.833609 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 102/171] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:22:42.091453 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-967c2d6f-6cc0-421c-b18a-85879a6008af tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:42.092180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-967c2d6f-6cc0-421c-b18a-85879a6008af tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:42.098835 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-967c2d6f-6cc0-421c-b18a-85879a6008af tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:42.099281 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-967c2d6f-6cc0-421c-b18a-85879a6008af tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:42.100037 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-967c2d6f-6cc0-421c-b18a-85879a6008af tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:42.100500 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-967c2d6f-6cc0-421c-b18a-85879a6008af tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:42.104450 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:42.240515 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-967c2d6f-6cc0-421c-b18a-85879a6008af tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:42.248403 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-967c2d6f-6cc0-421c-b18a-85879a6008af tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.161167 Jun 03 13:22:42.248969 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 103/172] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:42 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:42.292585 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-815b5741-df3b-4e9c-a03b-c3133bbe4209 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:42.293190 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-815b5741-df3b-4e9c-a03b-c3133bbe4209 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:42.299498 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-815b5741-df3b-4e9c-a03b-c3133bbe4209 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:42.299947 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-815b5741-df3b-4e9c-a03b-c3133bbe4209 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:42.300728 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-815b5741-df3b-4e9c-a03b-c3133bbe4209 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:42.301205 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-815b5741-df3b-4e9c-a03b-c3133bbe4209 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:42.444418 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-815b5741-df3b-4e9c-a03b-c3133bbe4209 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:42.452850 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-815b5741-df3b-4e9c-a03b-c3133bbe4209 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:42.454376 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-815b5741-df3b-4e9c-a03b-c3133bbe4209 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:42.455498 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-815b5741-df3b-4e9c-a03b-c3133bbe4209 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.166931 Jun 03 13:22:42.456225 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 104/173] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:42 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:42.458911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:42.580892 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=97 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:42.607829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b040f6b5-8fd7-4e55-946a-fe1c59bd8608 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:42.608393 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b040f6b5-8fd7-4e55-946a-fe1c59bd8608 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:42.615307 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b040f6b5-8fd7-4e55-946a-fe1c59bd8608 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:42.615759 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b040f6b5-8fd7-4e55-946a-fe1c59bd8608 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:42.616673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b040f6b5-8fd7-4e55-946a-fe1c59bd8608 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:42.617078 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b040f6b5-8fd7-4e55-946a-fe1c59bd8608 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:42.754056 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b040f6b5-8fd7-4e55-946a-fe1c59bd8608 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:42.762313 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b040f6b5-8fd7-4e55-946a-fe1c59bd8608 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.157884 Jun 03 13:22:42.762313 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 105/174] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:42 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:42.816287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-57e88076-dd92-479a-8928-357f71c1a552 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:42.816891 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-57e88076-dd92-479a-8928-357f71c1a552 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:42.822913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-57e88076-dd92-479a-8928-357f71c1a552 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:42.823385 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-57e88076-dd92-479a-8928-357f71c1a552 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:42.824207 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-57e88076-dd92-479a-8928-357f71c1a552 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:42.824638 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-57e88076-dd92-479a-8928-357f71c1a552 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:42.960656 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-57e88076-dd92-479a-8928-357f71c1a552 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:42.969451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-57e88076-dd92-479a-8928-357f71c1a552 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.156363 Jun 03 13:22:42.971213 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 106/175] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:42 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:43.266683 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-67c1eccb-f7d1-4645-a46e-d869a8c94328 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:43.267385 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-67c1eccb-f7d1-4645-a46e-d869a8c94328 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:43.273428 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67c1eccb-f7d1-4645-a46e-d869a8c94328 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:43.274164 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67c1eccb-f7d1-4645-a46e-d869a8c94328 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:43.275021 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67c1eccb-f7d1-4645-a46e-d869a8c94328 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:43.275503 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67c1eccb-f7d1-4645-a46e-d869a8c94328 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:43.446651 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-67c1eccb-f7d1-4645-a46e-d869a8c94328 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:43.454622 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-67c1eccb-f7d1-4645-a46e-d869a8c94328 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.192738 Jun 03 13:22:43.455193 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 107/176] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:43 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:43.474959 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3b0ca207-eec9-40c8-8fb7-69cd26b4d247 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:43.475801 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3b0ca207-eec9-40c8-8fb7-69cd26b4d247 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:43.485823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3b0ca207-eec9-40c8-8fb7-69cd26b4d247 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:43.486577 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3b0ca207-eec9-40c8-8fb7-69cd26b4d247 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:43.488186 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3b0ca207-eec9-40c8-8fb7-69cd26b4d247 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:43.488750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3b0ca207-eec9-40c8-8fb7-69cd26b4d247 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:43.631093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3b0ca207-eec9-40c8-8fb7-69cd26b4d247 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:43.639435 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3b0ca207-eec9-40c8-8fb7-69cd26b4d247 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:43.642107 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3b0ca207-eec9-40c8-8fb7-69cd26b4d247 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:43.643215 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3b0ca207-eec9-40c8-8fb7-69cd26b4d247 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.173778 Jun 03 13:22:43.643778 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 108/177] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:43 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:43.779408 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-af560b1e-eb1b-4806-965c-0cbfb2c2d299 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:43.780087 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-af560b1e-eb1b-4806-965c-0cbfb2c2d299 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:43.788654 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-af560b1e-eb1b-4806-965c-0cbfb2c2d299 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:43.789410 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-af560b1e-eb1b-4806-965c-0cbfb2c2d299 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:43.790686 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-af560b1e-eb1b-4806-965c-0cbfb2c2d299 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:43.791398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-af560b1e-eb1b-4806-965c-0cbfb2c2d299 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:43.936544 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-af560b1e-eb1b-4806-965c-0cbfb2c2d299 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:43.944583 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-af560b1e-eb1b-4806-965c-0cbfb2c2d299 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.169464 Jun 03 13:22:43.945089 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 109/178] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:43 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:43.991456 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c6b7d876-2a79-48a7-9221-efaf9d0f1a7b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:43.992124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c6b7d876-2a79-48a7-9221-efaf9d0f1a7b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:43.998870 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c6b7d876-2a79-48a7-9221-efaf9d0f1a7b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:43.999455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c6b7d876-2a79-48a7-9221-efaf9d0f1a7b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:44.000391 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c6b7d876-2a79-48a7-9221-efaf9d0f1a7b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:44.000902 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c6b7d876-2a79-48a7-9221-efaf9d0f1a7b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:44.154208 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c6b7d876-2a79-48a7-9221-efaf9d0f1a7b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:44.163691 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c6b7d876-2a79-48a7-9221-efaf9d0f1a7b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.176420 Jun 03 13:22:44.168690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 110/179] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:43 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:44.471719 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b386fafd-21fb-4b26-b657-c81ddf6d994f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:44.472318 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b386fafd-21fb-4b26-b657-c81ddf6d994f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:44.478670 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b386fafd-21fb-4b26-b657-c81ddf6d994f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:44.479116 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b386fafd-21fb-4b26-b657-c81ddf6d994f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:44.479868 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b386fafd-21fb-4b26-b657-c81ddf6d994f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:44.480336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b386fafd-21fb-4b26-b657-c81ddf6d994f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:44.623337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b386fafd-21fb-4b26-b657-c81ddf6d994f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:44.633369 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b386fafd-21fb-4b26-b657-c81ddf6d994f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.165705 Jun 03 13:22:44.634036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 111/180] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:44 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:44.662016 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7b77a625-ba73-425c-94e4-021f0bed0460 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:44.669015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7b77a625-ba73-425c-94e4-021f0bed0460 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:44.669015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7b77a625-ba73-425c-94e4-021f0bed0460 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:44.669387 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7b77a625-ba73-425c-94e4-021f0bed0460 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:44.670153 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7b77a625-ba73-425c-94e4-021f0bed0460 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:44.670593 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7b77a625-ba73-425c-94e4-021f0bed0460 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:45.068331 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7b77a625-ba73-425c-94e4-021f0bed0460 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:45.068331 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7b77a625-ba73-425c-94e4-021f0bed0460 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:45.069604 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7b77a625-ba73-425c-94e4-021f0bed0460 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:45.069604 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7b77a625-ba73-425c-94e4-021f0bed0460 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.337541 Jun 03 13:22:45.069604 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 112/181] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:44 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:45.069604 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e6ee3d80-9132-4f57-94b7-8b4515cc7a98 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:45.069970 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e6ee3d80-9132-4f57-94b7-8b4515cc7a98 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:45.069970 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6ee3d80-9132-4f57-94b7-8b4515cc7a98 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:45.069970 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6ee3d80-9132-4f57-94b7-8b4515cc7a98 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:45.069970 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6ee3d80-9132-4f57-94b7-8b4515cc7a98 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:45.070297 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6ee3d80-9132-4f57-94b7-8b4515cc7a98 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:45.164406 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e6ee3d80-9132-4f57-94b7-8b4515cc7a98 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:45.172273 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e6ee3d80-9132-4f57-94b7-8b4515cc7a98 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.175100 Jun 03 13:22:45.173226 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 113/182] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:44 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:45.181694 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-65cfdad0-4c70-4c49-9249-f95f3cf5020d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:45.182312 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-65cfdad0-4c70-4c49-9249-f95f3cf5020d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:45.184231 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:45.190884 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-65cfdad0-4c70-4c49-9249-f95f3cf5020d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:45.212969 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-65cfdad0-4c70-4c49-9249-f95f3cf5020d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:45.212969 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-65cfdad0-4c70-4c49-9249-f95f3cf5020d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:45.212969 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-65cfdad0-4c70-4c49-9249-f95f3cf5020d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:45.355179 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-65cfdad0-4c70-4c49-9249-f95f3cf5020d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:45.363309 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-65cfdad0-4c70-4c49-9249-f95f3cf5020d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.185429 Jun 03 13:22:45.364130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 114/183] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:45 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:45.652286 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2913421b-94f3-4d33-956c-5db7e0b8ca9b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:45.652929 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2913421b-94f3-4d33-956c-5db7e0b8ca9b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:45.659419 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2913421b-94f3-4d33-956c-5db7e0b8ca9b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:45.659962 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2913421b-94f3-4d33-956c-5db7e0b8ca9b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:45.660737 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2913421b-94f3-4d33-956c-5db7e0b8ca9b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:45.661169 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2913421b-94f3-4d33-956c-5db7e0b8ca9b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:46.008988 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2913421b-94f3-4d33-956c-5db7e0b8ca9b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:46.019235 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2913421b-94f3-4d33-956c-5db7e0b8ca9b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.371269 Jun 03 13:22:46.020066 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 115/184] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:45 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:46.062925 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8788b2e0-e624-457d-a28e-41b1037f3dd1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:46.063777 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8788b2e0-e624-457d-a28e-41b1037f3dd1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:46.073548 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8788b2e0-e624-457d-a28e-41b1037f3dd1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:46.074409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8788b2e0-e624-457d-a28e-41b1037f3dd1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:46.075949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8788b2e0-e624-457d-a28e-41b1037f3dd1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:46.076709 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8788b2e0-e624-457d-a28e-41b1037f3dd1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:46.309843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8788b2e0-e624-457d-a28e-41b1037f3dd1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:46.323616 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8788b2e0-e624-457d-a28e-41b1037f3dd1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:46.326142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8788b2e0-e624-457d-a28e-41b1037f3dd1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:46.330664 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8788b2e0-e624-457d-a28e-41b1037f3dd1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.274167 Jun 03 13:22:46.347564 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 116/185] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:46 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:46.357811 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f786a5af-18c9-46af-a6c7-70ba597f54b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:46.358526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f786a5af-18c9-46af-a6c7-70ba597f54b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:46.366147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f786a5af-18c9-46af-a6c7-70ba597f54b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:46.366706 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f786a5af-18c9-46af-a6c7-70ba597f54b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:46.367593 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f786a5af-18c9-46af-a6c7-70ba597f54b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:46.368689 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f786a5af-18c9-46af-a6c7-70ba597f54b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:46.548840 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f786a5af-18c9-46af-a6c7-70ba597f54b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:46.556700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f786a5af-18c9-46af-a6c7-70ba597f54b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.210738 Jun 03 13:22:46.557452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 117/186] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:46 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:46.560449 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-271221ab-1fbd-48fc-a961-d9cdb7540b59 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "POST /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.111513 Jun 03 13:22:46.564370 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 70/187] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:22:32 2022] POST /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0/os-volume_attachments => generated 194 bytes in 14116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:22:46.567952 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-334c1fc9-7ab8-4067-91e0-be974738d320 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:46.568592 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-334c1fc9-7ab8-4067-91e0-be974738d320 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:46.578776 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-334c1fc9-7ab8-4067-91e0-be974738d320 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:46.579541 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-334c1fc9-7ab8-4067-91e0-be974738d320 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:46.580506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-334c1fc9-7ab8-4067-91e0-be974738d320 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:46.581059 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-334c1fc9-7ab8-4067-91e0-be974738d320 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:46.747069 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-334c1fc9-7ab8-4067-91e0-be974738d320 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:46.758471 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-334c1fc9-7ab8-4067-91e0-be974738d320 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.198919 Jun 03 13:22:46.759869 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 118/188] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:46 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:47.037991 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4cd893fd-dffb-44c5-82b0-d92e8963cd68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:47.039238 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4cd893fd-dffb-44c5-82b0-d92e8963cd68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:47.052677 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4cd893fd-dffb-44c5-82b0-d92e8963cd68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:47.053240 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4cd893fd-dffb-44c5-82b0-d92e8963cd68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:47.054164 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4cd893fd-dffb-44c5-82b0-d92e8963cd68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:47.054829 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4cd893fd-dffb-44c5-82b0-d92e8963cd68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:47.296052 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4cd893fd-dffb-44c5-82b0-d92e8963cd68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:47.304358 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4cd893fd-dffb-44c5-82b0-d92e8963cd68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.270865 Jun 03 13:22:47.305498 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 71/189] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:47 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:47.352829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-dcd2d162-6fa9-444c-8718-e9763cdcbc28 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:47.353529 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-dcd2d162-6fa9-444c-8718-e9763cdcbc28 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:47.363036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dcd2d162-6fa9-444c-8718-e9763cdcbc28 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:47.363670 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dcd2d162-6fa9-444c-8718-e9763cdcbc28 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:47.364484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dcd2d162-6fa9-444c-8718-e9763cdcbc28 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:47.364933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dcd2d162-6fa9-444c-8718-e9763cdcbc28 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:47.393471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-a3d8e21a-8e4e-4d71-bb1f-97b935d50368 req-2c81ea39-c28d-427f-a234-a8099e7264ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a334af7a-c5bb-4c6e-aa37-bb7c86b838c2", "name": "network-vif-plugged", "status": "completed", "tag": "77ec7712-763e-4c88-ad78-1277b03066fd"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:47.404581 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-a3d8e21a-8e4e-4d71-bb1f-97b935d50368 req-2c81ea39-c28d-427f-a234-a8099e7264ed service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:47.405082 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-a3d8e21a-8e4e-4d71-bb1f-97b935d50368 req-2c81ea39-c28d-427f-a234-a8099e7264ed service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:47.417180 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-a3d8e21a-8e4e-4d71-bb1f-97b935d50368 req-2c81ea39-c28d-427f-a234-a8099e7264ed service nova] Creating event network-vif-plugged:77ec7712-763e-4c88-ad78-1277b03066fd for instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 on hv-cinder-80135 Jun 03 13:22:47.422991 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-a3d8e21a-8e4e-4d71-bb1f-97b935d50368 req-2c81ea39-c28d-427f-a234-a8099e7264ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033771 Jun 03 13:22:47.423713 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 72/190] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:22:47.516042 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-dcd2d162-6fa9-444c-8718-e9763cdcbc28 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:47.518245 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:47.541700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-dcd2d162-6fa9-444c-8718-e9763cdcbc28 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:47.543242 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-dcd2d162-6fa9-444c-8718-e9763cdcbc28 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:47.544416 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-dcd2d162-6fa9-444c-8718-e9763cdcbc28 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.198484 Jun 03 13:22:47.545136 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 119/191] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:47 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:47.579591 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d1757c38-ebbb-40a4-bb7a-e1ec6c0a037a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:47.580406 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d1757c38-ebbb-40a4-bb7a-e1ec6c0a037a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:47.586854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d1757c38-ebbb-40a4-bb7a-e1ec6c0a037a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:47.587309 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d1757c38-ebbb-40a4-bb7a-e1ec6c0a037a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:47.588082 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d1757c38-ebbb-40a4-bb7a-e1ec6c0a037a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:47.588695 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d1757c38-ebbb-40a4-bb7a-e1ec6c0a037a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:47.777133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-faf7f6db-0360-4146-85f5-c1d033252409 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:47.778804 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-faf7f6db-0360-4146-85f5-c1d033252409 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:47.797010 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-faf7f6db-0360-4146-85f5-c1d033252409 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:47.801619 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-faf7f6db-0360-4146-85f5-c1d033252409 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:47.801619 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-faf7f6db-0360-4146-85f5-c1d033252409 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:47.801619 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-faf7f6db-0360-4146-85f5-c1d033252409 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:47.940971 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d1757c38-ebbb-40a4-bb7a-e1ec6c0a037a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:47.949537 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d1757c38-ebbb-40a4-bb7a-e1ec6c0a037a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.374288 Jun 03 13:22:47.950117 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 73/192] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:47 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:48.008238 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-faf7f6db-0360-4146-85f5-c1d033252409 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:48.012015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-faf7f6db-0360-4146-85f5-c1d033252409 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.239754 Jun 03 13:22:48.012818 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 120/193] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:47 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:48.325024 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a492309b-56fe-4511-83df-73875a38a40d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:48.325706 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a492309b-56fe-4511-83df-73875a38a40d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:48.341179 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a492309b-56fe-4511-83df-73875a38a40d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:48.344094 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a492309b-56fe-4511-83df-73875a38a40d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:48.345699 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a492309b-56fe-4511-83df-73875a38a40d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:48.346393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a492309b-56fe-4511-83df-73875a38a40d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:48.563274 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-00540089-ae23-4d20-9889-0f56f8265051 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:48.564081 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-00540089-ae23-4d20-9889-0f56f8265051 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:48.580428 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-00540089-ae23-4d20-9889-0f56f8265051 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:48.581141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-00540089-ae23-4d20-9889-0f56f8265051 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:48.581915 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-00540089-ae23-4d20-9889-0f56f8265051 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:48.582586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-00540089-ae23-4d20-9889-0f56f8265051 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:48.647109 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a492309b-56fe-4511-83df-73875a38a40d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:48.656981 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a492309b-56fe-4511-83df-73875a38a40d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.336891 Jun 03 13:22:48.657704 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 74/194] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:48 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:48.739962 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-00540089-ae23-4d20-9889-0f56f8265051 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:48.748401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-00540089-ae23-4d20-9889-0f56f8265051 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:48.751165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-00540089-ae23-4d20-9889-0f56f8265051 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:48.752299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-00540089-ae23-4d20-9889-0f56f8265051 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.193505 Jun 03 13:22:48.752914 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 121/195] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:48 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:48.974019 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-bf69aa79-4b8d-45cc-9660-ad63c551abc7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:48.974673 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-bf69aa79-4b8d-45cc-9660-ad63c551abc7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:48.980679 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bf69aa79-4b8d-45cc-9660-ad63c551abc7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:48.981127 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bf69aa79-4b8d-45cc-9660-ad63c551abc7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:48.981905 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bf69aa79-4b8d-45cc-9660-ad63c551abc7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:48.982345 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bf69aa79-4b8d-45cc-9660-ad63c551abc7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:49.029791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-601c37ef-de6d-4d9c-ae85-f5bcb802d59f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:49.031770 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-601c37ef-de6d-4d9c-ae85-f5bcb802d59f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:49.037956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-601c37ef-de6d-4d9c-ae85-f5bcb802d59f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:49.039389 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-601c37ef-de6d-4d9c-ae85-f5bcb802d59f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:49.040906 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-601c37ef-de6d-4d9c-ae85-f5bcb802d59f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:49.041744 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-601c37ef-de6d-4d9c-ae85-f5bcb802d59f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:49.241255 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-601c37ef-de6d-4d9c-ae85-f5bcb802d59f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:49.248925 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-bf69aa79-4b8d-45cc-9660-ad63c551abc7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:49.256694 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-601c37ef-de6d-4d9c-ae85-f5bcb802d59f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.230850 Jun 03 13:22:49.257705 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-bf69aa79-4b8d-45cc-9660-ad63c551abc7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.293199 Jun 03 13:22:49.258635 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 122/197] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:49 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:49.258819 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 75/197] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:48 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:49.437787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-b3043e23-9621-4fc7-87a1-66c94158c2ac req-1c1a3e91-13fa-4446-aa73-be05f750b3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f916e17-eccc-4c6d-b3cd-9517056abcfc", "name": "network-vif-plugged", "status": "completed", "tag": "24f2a109-5081-4497-ba6a-88eaca5fa11c"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:49.446738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-b3043e23-9621-4fc7-87a1-66c94158c2ac req-1c1a3e91-13fa-4446-aa73-be05f750b3a2 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:49.447218 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-b3043e23-9621-4fc7-87a1-66c94158c2ac req-1c1a3e91-13fa-4446-aa73-be05f750b3a2 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:49.460083 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-b3043e23-9621-4fc7-87a1-66c94158c2ac req-1c1a3e91-13fa-4446-aa73-be05f750b3a2 service nova] Creating event network-vif-plugged:24f2a109-5081-4497-ba6a-88eaca5fa11c for instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc on hv-cinder-80135 Jun 03 13:22:49.470293 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-b3043e23-9621-4fc7-87a1-66c94158c2ac req-1c1a3e91-13fa-4446-aa73-be05f750b3a2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036615 Jun 03 13:22:49.470925 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 123/198] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:22:49.675390 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-81385cb8-b053-408f-a0c4-fb97eeedaaa4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:49.676186 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-81385cb8-b053-408f-a0c4-fb97eeedaaa4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:49.682779 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-81385cb8-b053-408f-a0c4-fb97eeedaaa4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:49.683367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-81385cb8-b053-408f-a0c4-fb97eeedaaa4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:49.684138 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-81385cb8-b053-408f-a0c4-fb97eeedaaa4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:49.684602 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-81385cb8-b053-408f-a0c4-fb97eeedaaa4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:49.771154 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1ee02fd2-f306-4c89-bcca-cb2bfa5c038b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:49.771956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-1ee02fd2-f306-4c89-bcca-cb2bfa5c038b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:49.784706 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1ee02fd2-f306-4c89-bcca-cb2bfa5c038b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:49.785348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1ee02fd2-f306-4c89-bcca-cb2bfa5c038b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:49.786266 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1ee02fd2-f306-4c89-bcca-cb2bfa5c038b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:49.786703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1ee02fd2-f306-4c89-bcca-cb2bfa5c038b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:49.848023 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-81385cb8-b053-408f-a0c4-fb97eeedaaa4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:49.856008 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-81385cb8-b053-408f-a0c4-fb97eeedaaa4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.185263 Jun 03 13:22:49.856695 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 76/199] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:49 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:49.935735 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1ee02fd2-f306-4c89-bcca-cb2bfa5c038b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:49.944587 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1ee02fd2-f306-4c89-bcca-cb2bfa5c038b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:49.946188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1ee02fd2-f306-4c89-bcca-cb2bfa5c038b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:49.947380 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1ee02fd2-f306-4c89-bcca-cb2bfa5c038b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.180737 Jun 03 13:22:49.958208 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 124/200] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:49 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:50.275018 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f28a874b-2e4c-4a7f-a3f2-ff31492d7344 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:50.275893 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f28a874b-2e4c-4a7f-a3f2-ff31492d7344 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:50.276497 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-685f50e7-ed4f-4116-a9dd-d541422b51d4 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:50.277156 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-685f50e7-ed4f-4116-a9dd-d541422b51d4 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:50.284235 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-685f50e7-ed4f-4116-a9dd-d541422b51d4 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:50.284692 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-685f50e7-ed4f-4116-a9dd-d541422b51d4 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:50.285466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-685f50e7-ed4f-4116-a9dd-d541422b51d4 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:50.286053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-685f50e7-ed4f-4116-a9dd-d541422b51d4 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:50.286215 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f28a874b-2e4c-4a7f-a3f2-ff31492d7344 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:50.287371 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f28a874b-2e4c-4a7f-a3f2-ff31492d7344 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:50.288709 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f28a874b-2e4c-4a7f-a3f2-ff31492d7344 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:50.289405 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f28a874b-2e4c-4a7f-a3f2-ff31492d7344 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:50.438750 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f28a874b-2e4c-4a7f-a3f2-ff31492d7344 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:50.446519 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f28a874b-2e4c-4a7f-a3f2-ff31492d7344 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.175694 Jun 03 13:22:50.447099 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 77/201] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:50 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:50.515053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-685f50e7-ed4f-4116-a9dd-d541422b51d4 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:50.522747 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-685f50e7-ed4f-4116-a9dd-d541422b51d4 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.250871 Jun 03 13:22:50.523310 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 125/202] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:50 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:50.873931 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d2c820d3-a3ba-49a6-910f-368c71e8467c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:50.875115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d2c820d3-a3ba-49a6-910f-368c71e8467c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:50.881446 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d2c820d3-a3ba-49a6-910f-368c71e8467c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:50.881895 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d2c820d3-a3ba-49a6-910f-368c71e8467c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:50.887838 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d2c820d3-a3ba-49a6-910f-368c71e8467c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:50.887838 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d2c820d3-a3ba-49a6-910f-368c71e8467c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:50.965754 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a734c79d-c7c8-4bfe-8425-a6e18c94f16a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:50.966392 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a734c79d-c7c8-4bfe-8425-a6e18c94f16a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:50.983077 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a734c79d-c7c8-4bfe-8425-a6e18c94f16a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:50.983077 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a734c79d-c7c8-4bfe-8425-a6e18c94f16a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:50.983077 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a734c79d-c7c8-4bfe-8425-a6e18c94f16a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:50.983077 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a734c79d-c7c8-4bfe-8425-a6e18c94f16a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:51.050971 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d2c820d3-a3ba-49a6-910f-368c71e8467c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:51.058946 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d2c820d3-a3ba-49a6-910f-368c71e8467c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.188926 Jun 03 13:22:51.059513 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 78/203] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:50 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:51.126693 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a734c79d-c7c8-4bfe-8425-a6e18c94f16a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:51.134720 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a734c79d-c7c8-4bfe-8425-a6e18c94f16a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:51.136297 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a734c79d-c7c8-4bfe-8425-a6e18c94f16a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:51.137452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a734c79d-c7c8-4bfe-8425-a6e18c94f16a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.175725 Jun 03 13:22:51.137997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 126/204] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:50 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:51.464074 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9b6cd7a4-24ee-4ffe-9060-3ddc92b94de6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:51.464728 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-9b6cd7a4-24ee-4ffe-9060-3ddc92b94de6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:51.470930 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9b6cd7a4-24ee-4ffe-9060-3ddc92b94de6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:51.471381 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9b6cd7a4-24ee-4ffe-9060-3ddc92b94de6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:51.472134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9b6cd7a4-24ee-4ffe-9060-3ddc92b94de6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:51.472596 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9b6cd7a4-24ee-4ffe-9060-3ddc92b94de6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:51.539207 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-348f6f7b-60fe-4548-a4a5-c44a8ede609d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:51.539821 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-348f6f7b-60fe-4548-a4a5-c44a8ede609d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:51.546594 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-348f6f7b-60fe-4548-a4a5-c44a8ede609d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:51.547042 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-348f6f7b-60fe-4548-a4a5-c44a8ede609d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:51.548001 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-348f6f7b-60fe-4548-a4a5-c44a8ede609d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:51.549035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-348f6f7b-60fe-4548-a4a5-c44a8ede609d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:51.686248 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9b6cd7a4-24ee-4ffe-9060-3ddc92b94de6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:51.700408 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9b6cd7a4-24ee-4ffe-9060-3ddc92b94de6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.238529 Jun 03 13:22:51.702030 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 79/205] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:51 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:51.707826 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-348f6f7b-60fe-4548-a4a5-c44a8ede609d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:51.715240 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-348f6f7b-60fe-4548-a4a5-c44a8ede609d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.179884 Jun 03 13:22:51.716358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 127/206] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:51 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:52.075016 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-cb15df3f-f273-46c2-b520-f12b543ec952 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:52.075630 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-cb15df3f-f273-46c2-b520-f12b543ec952 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:52.082785 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cb15df3f-f273-46c2-b520-f12b543ec952 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:52.085222 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cb15df3f-f273-46c2-b520-f12b543ec952 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:52.085222 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cb15df3f-f273-46c2-b520-f12b543ec952 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:52.085222 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cb15df3f-f273-46c2-b520-f12b543ec952 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:52.156044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6a0bbd91-fb77-468c-a0d5-163d223bcf53 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:52.156724 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6a0bbd91-fb77-468c-a0d5-163d223bcf53 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:52.162758 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6a0bbd91-fb77-468c-a0d5-163d223bcf53 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:52.163164 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6a0bbd91-fb77-468c-a0d5-163d223bcf53 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:52.163926 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6a0bbd91-fb77-468c-a0d5-163d223bcf53 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:52.164460 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6a0bbd91-fb77-468c-a0d5-163d223bcf53 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:52.236249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-cb15df3f-f273-46c2-b520-f12b543ec952 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:52.245697 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-cb15df3f-f273-46c2-b520-f12b543ec952 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.174625 Jun 03 13:22:52.246272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 80/207] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:52 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:52.317672 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6a0bbd91-fb77-468c-a0d5-163d223bcf53 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:52.326214 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6a0bbd91-fb77-468c-a0d5-163d223bcf53 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:52.328784 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6a0bbd91-fb77-468c-a0d5-163d223bcf53 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:52.330654 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6a0bbd91-fb77-468c-a0d5-163d223bcf53 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.179180 Jun 03 13:22:52.331217 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 128/208] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:52 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:52.718760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-68ec099f-5689-4462-a4ac-e34912732368 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:52.719407 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-68ec099f-5689-4462-a4ac-e34912732368 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:52.725428 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-68ec099f-5689-4462-a4ac-e34912732368 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:52.726056 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-68ec099f-5689-4462-a4ac-e34912732368 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:52.726991 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-68ec099f-5689-4462-a4ac-e34912732368 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:52.727725 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-68ec099f-5689-4462-a4ac-e34912732368 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:52.735733 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a0557815-6b47-4eda-8a2a-5ef52f57e21f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:52.736399 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a0557815-6b47-4eda-8a2a-5ef52f57e21f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:52.743314 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a0557815-6b47-4eda-8a2a-5ef52f57e21f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:52.743756 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a0557815-6b47-4eda-8a2a-5ef52f57e21f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:52.744752 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a0557815-6b47-4eda-8a2a-5ef52f57e21f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:52.745353 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a0557815-6b47-4eda-8a2a-5ef52f57e21f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:52.867289 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-68ec099f-5689-4462-a4ac-e34912732368 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:52.876099 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-68ec099f-5689-4462-a4ac-e34912732368 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.161244 Jun 03 13:22:52.876699 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 81/209] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:52 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:52.891272 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a0557815-6b47-4eda-8a2a-5ef52f57e21f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:52.899296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a0557815-6b47-4eda-8a2a-5ef52f57e21f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.170668 Jun 03 13:22:52.899851 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 129/210] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:52 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:53.262889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-01b801c0-2223-4802-8818-00f66af54861 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:53.263424 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-01b801c0-2223-4802-8818-00f66af54861 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:53.272921 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-01b801c0-2223-4802-8818-00f66af54861 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:53.273367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-01b801c0-2223-4802-8818-00f66af54861 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:53.274134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-01b801c0-2223-4802-8818-00f66af54861 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:53.274734 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-01b801c0-2223-4802-8818-00f66af54861 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:53.352806 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-062abc88-8584-4d3d-aecb-f3e79520ed49 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:53.354222 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-062abc88-8584-4d3d-aecb-f3e79520ed49 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:53.360694 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-062abc88-8584-4d3d-aecb-f3e79520ed49 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:53.361303 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-062abc88-8584-4d3d-aecb-f3e79520ed49 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:53.362167 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-062abc88-8584-4d3d-aecb-f3e79520ed49 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:53.362697 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-062abc88-8584-4d3d-aecb-f3e79520ed49 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:53.417811 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-01b801c0-2223-4802-8818-00f66af54861 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:53.425386 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-01b801c0-2223-4802-8818-00f66af54861 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.166621 Jun 03 13:22:53.425969 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 82/211] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:53 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:53.503845 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-062abc88-8584-4d3d-aecb-f3e79520ed49 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:53.512043 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-062abc88-8584-4d3d-aecb-f3e79520ed49 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:53.513614 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-062abc88-8584-4d3d-aecb-f3e79520ed49 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:53.515509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-062abc88-8584-4d3d-aecb-f3e79520ed49 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.169799 Jun 03 13:22:53.516123 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 130/212] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:53 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:53.893566 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-020ba29f-bcbf-496e-9b60-703197719f5d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:53.894171 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-020ba29f-bcbf-496e-9b60-703197719f5d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:53.901168 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-020ba29f-bcbf-496e-9b60-703197719f5d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:53.904731 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-020ba29f-bcbf-496e-9b60-703197719f5d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:53.904731 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-020ba29f-bcbf-496e-9b60-703197719f5d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:53.904731 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-020ba29f-bcbf-496e-9b60-703197719f5d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:53.917735 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0becc090-005e-4975-8edc-dca1d84a0a71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:53.919245 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0becc090-005e-4975-8edc-dca1d84a0a71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:53.931529 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0becc090-005e-4975-8edc-dca1d84a0a71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:53.932601 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0becc090-005e-4975-8edc-dca1d84a0a71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:53.933541 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0becc090-005e-4975-8edc-dca1d84a0a71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:53.934327 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0becc090-005e-4975-8edc-dca1d84a0a71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:54.115370 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0becc090-005e-4975-8edc-dca1d84a0a71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:54.126038 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0becc090-005e-4975-8edc-dca1d84a0a71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.213095 Jun 03 13:22:54.129263 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 131/213] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:53 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:54.161501 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-020ba29f-bcbf-496e-9b60-703197719f5d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:54.170859 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-020ba29f-bcbf-496e-9b60-703197719f5d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.281829 Jun 03 13:22:54.173785 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 83/214] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:53 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:54.245557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-3ac1d24a-398d-47b7-ba4c-57ff5e94a15c req-c333c301-1c27-4159-890d-f31364ce9d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2968dd86-2754-4322-aae8-39fa37b9826f", "name": "network-vif-plugged", "status": "completed", "tag": "8e15e8ed-2b3b-4de4-b402-39e1c2a41fcd"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:54.254952 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-3ac1d24a-398d-47b7-ba4c-57ff5e94a15c req-c333c301-1c27-4159-890d-f31364ce9d49 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:54.255452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-3ac1d24a-398d-47b7-ba4c-57ff5e94a15c req-c333c301-1c27-4159-890d-f31364ce9d49 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:54.267185 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-3ac1d24a-398d-47b7-ba4c-57ff5e94a15c req-c333c301-1c27-4159-890d-f31364ce9d49 service nova] Creating event network-vif-plugged:8e15e8ed-2b3b-4de4-b402-39e1c2a41fcd for instance 2968dd86-2754-4322-aae8-39fa37b9826f on hv-cinder-80135 Jun 03 13:22:54.273195 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-3ac1d24a-398d-47b7-ba4c-57ff5e94a15c req-c333c301-1c27-4159-890d-f31364ce9d49 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031513 Jun 03 13:22:54.273843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 132/215] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:22:54.448527 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-2bc31afb-193e-44eb-a857-e4fd05321611 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:54.448527 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-2bc31afb-193e-44eb-a857-e4fd05321611 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:54.458426 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2bc31afb-193e-44eb-a857-e4fd05321611 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:54.459312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2bc31afb-193e-44eb-a857-e4fd05321611 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:54.461011 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2bc31afb-193e-44eb-a857-e4fd05321611 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:54.461977 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2bc31afb-193e-44eb-a857-e4fd05321611 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:54.535116 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9773c273-4fb6-4d62-92c7-944f27cc0820 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:54.536249 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9773c273-4fb6-4d62-92c7-944f27cc0820 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:54.551913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9773c273-4fb6-4d62-92c7-944f27cc0820 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:54.553787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9773c273-4fb6-4d62-92c7-944f27cc0820 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:54.555506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9773c273-4fb6-4d62-92c7-944f27cc0820 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:54.556800 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9773c273-4fb6-4d62-92c7-944f27cc0820 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:54.767371 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-2bc31afb-193e-44eb-a857-e4fd05321611 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:54.787155 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-2bc31afb-193e-44eb-a857-e4fd05321611 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.346892 Jun 03 13:22:54.788004 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 84/216] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:54 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:54.813756 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9773c273-4fb6-4d62-92c7-944f27cc0820 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:54.822195 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9773c273-4fb6-4d62-92c7-944f27cc0820 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:54.823786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9773c273-4fb6-4d62-92c7-944f27cc0820 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:54.824930 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9773c273-4fb6-4d62-92c7-944f27cc0820 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1408 microversion: 2.20 time: 0.294997 Jun 03 13:22:54.825667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 133/217] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:54 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:22:55.145445 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-536f4988-b05c-49ab-8613-5c9cf3ef4838 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:55.146153 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-536f4988-b05c-49ab-8613-5c9cf3ef4838 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:55.153160 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-536f4988-b05c-49ab-8613-5c9cf3ef4838 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:55.153690 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-536f4988-b05c-49ab-8613-5c9cf3ef4838 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:55.154472 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-536f4988-b05c-49ab-8613-5c9cf3ef4838 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:55.155093 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-536f4988-b05c-49ab-8613-5c9cf3ef4838 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:55.197140 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-833949b0-061a-422a-ac91-f7238469003b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:55.198127 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-833949b0-061a-422a-ac91-f7238469003b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:55.211088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-833949b0-061a-422a-ac91-f7238469003b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:55.212257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-833949b0-061a-422a-ac91-f7238469003b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:55.213405 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-833949b0-061a-422a-ac91-f7238469003b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:55.214214 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-833949b0-061a-422a-ac91-f7238469003b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:55.329962 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-536f4988-b05c-49ab-8613-5c9cf3ef4838 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:55.337826 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-536f4988-b05c-49ab-8613-5c9cf3ef4838 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.196253 Jun 03 13:22:55.338532 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 85/218] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:55 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:55.445403 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-833949b0-061a-422a-ac91-f7238469003b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:55.454756 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-833949b0-061a-422a-ac91-f7238469003b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.267822 Jun 03 13:22:55.455328 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 134/219] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:55 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:55.805543 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6742e3cb-33b7-4713-9186-d15adfc534aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:55.806359 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6742e3cb-33b7-4713-9186-d15adfc534aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:55.813775 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6742e3cb-33b7-4713-9186-d15adfc534aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:55.814221 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6742e3cb-33b7-4713-9186-d15adfc534aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:55.814984 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6742e3cb-33b7-4713-9186-d15adfc534aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:55.815414 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6742e3cb-33b7-4713-9186-d15adfc534aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:55.843745 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b324f2ba-f216-43f9-bed1-c69bd7d79c2f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:55.844371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b324f2ba-f216-43f9-bed1-c69bd7d79c2f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:55.850553 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b324f2ba-f216-43f9-bed1-c69bd7d79c2f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:55.851770 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b324f2ba-f216-43f9-bed1-c69bd7d79c2f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:55.852060 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b324f2ba-f216-43f9-bed1-c69bd7d79c2f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:55.852529 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b324f2ba-f216-43f9-bed1-c69bd7d79c2f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:55.987689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6742e3cb-33b7-4713-9186-d15adfc534aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:55.995899 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:56.001440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6742e3cb-33b7-4713-9186-d15adfc534aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.200015 Jun 03 13:22:56.002136 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 86/220] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:55 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:56.042816 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b324f2ba-f216-43f9-bed1-c69bd7d79c2f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:56.051726 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b324f2ba-f216-43f9-bed1-c69bd7d79c2f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:56.053589 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b324f2ba-f216-43f9-bed1-c69bd7d79c2f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:56.054746 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b324f2ba-f216-43f9-bed1-c69bd7d79c2f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1601 microversion: 2.20 time: 0.215653 Jun 03 13:22:56.055300 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 135/221] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:22:55 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1601 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:22:56.073465 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-df4e564f-7143-4791-997c-fc51a0af8818 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:56.073956 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-df4e564f-7143-4791-997c-fc51a0af8818 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:56.081471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-df4e564f-7143-4791-997c-fc51a0af8818 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:56.082043 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-df4e564f-7143-4791-997c-fc51a0af8818 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:56.082804 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-df4e564f-7143-4791-997c-fc51a0af8818 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:56.083235 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-df4e564f-7143-4791-997c-fc51a0af8818 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:56.169528 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-df4e564f-7143-4791-997c-fc51a0af8818 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100185 Jun 03 13:22:56.170517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 87/222] 10.222.0.61 () {60 vars in 1315 bytes} [Fri Jun 3 13:22:56 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:22:56.355685 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8cab1d75-c732-4968-8479-51414010eac3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:56.356729 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8cab1d75-c732-4968-8479-51414010eac3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:56.363900 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8cab1d75-c732-4968-8479-51414010eac3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:56.364472 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8cab1d75-c732-4968-8479-51414010eac3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:56.365315 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8cab1d75-c732-4968-8479-51414010eac3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:56.365922 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8cab1d75-c732-4968-8479-51414010eac3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:56.471030 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a007ac37-4bb1-436b-8273-834ccae4b42e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:56.471966 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a007ac37-4bb1-436b-8273-834ccae4b42e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:56.478588 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a007ac37-4bb1-436b-8273-834ccae4b42e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:56.480304 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a007ac37-4bb1-436b-8273-834ccae4b42e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:56.483091 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a007ac37-4bb1-436b-8273-834ccae4b42e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:56.485343 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a007ac37-4bb1-436b-8273-834ccae4b42e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:56.620941 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8cab1d75-c732-4968-8479-51414010eac3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:56.631777 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8cab1d75-c732-4968-8479-51414010eac3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.280829 Jun 03 13:22:56.641633 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 136/223] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:56 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:56.645300 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a007ac37-4bb1-436b-8273-834ccae4b42e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:56.659305 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a007ac37-4bb1-436b-8273-834ccae4b42e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.192264 Jun 03 13:22:56.660034 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 88/224] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:56 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:57.026575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-313ef778-2c7f-4288-bd46-98c9f0ea2f61 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:57.027328 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-313ef778-2c7f-4288-bd46-98c9f0ea2f61 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:57.041855 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-313ef778-2c7f-4288-bd46-98c9f0ea2f61 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:57.042485 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-313ef778-2c7f-4288-bd46-98c9f0ea2f61 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:57.043438 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-313ef778-2c7f-4288-bd46-98c9f0ea2f61 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:57.044033 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-313ef778-2c7f-4288-bd46-98c9f0ea2f61 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:57.469942 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-313ef778-2c7f-4288-bd46-98c9f0ea2f61 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:57.472716 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:57.478723 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-313ef778-2c7f-4288-bd46-98c9f0ea2f61 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1363 microversion: 2.1 time: 0.463649 Jun 03 13:22:57.484979 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 137/225] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:57 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1363 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:57.648115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-52b2d10d-019c-43de-b418-81d5d9319f51 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:57.648756 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-52b2d10d-019c-43de-b418-81d5d9319f51 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:57.656316 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-52b2d10d-019c-43de-b418-81d5d9319f51 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:57.656877 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-52b2d10d-019c-43de-b418-81d5d9319f51 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:57.657565 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-52b2d10d-019c-43de-b418-81d5d9319f51 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:57.658006 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-52b2d10d-019c-43de-b418-81d5d9319f51 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:57.677092 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d6d79cc4-f533-4d73-ba10-c4643e425b79 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:57.677746 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d6d79cc4-f533-4d73-ba10-c4643e425b79 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:57.684339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6d79cc4-f533-4d73-ba10-c4643e425b79 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:57.685092 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6d79cc4-f533-4d73-ba10-c4643e425b79 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:57.686069 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6d79cc4-f533-4d73-ba10-c4643e425b79 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:57.686698 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6d79cc4-f533-4d73-ba10-c4643e425b79 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:57.813954 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-52b2d10d-019c-43de-b418-81d5d9319f51 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:57.823425 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-52b2d10d-019c-43de-b418-81d5d9319f51 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.178993 Jun 03 13:22:57.824004 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 89/226] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:57 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:57.836992 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-9a9a85b7-f532-4816-a4f3-069d3c47ffde req-f8be22f3-a292-4f04-8153-0a4aea34d182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f119f5f-b6ed-45a0-a780-b1e037c96cc1", "tag": "14995843-d975-4a00-9ad9-746c61f720d5"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:57.849254 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-9a9a85b7-f532-4816-a4f3-069d3c47ffde req-f8be22f3-a292-4f04-8153-0a4aea34d182 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:57.849845 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-9a9a85b7-f532-4816-a4f3-069d3c47ffde req-f8be22f3-a292-4f04-8153-0a4aea34d182 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:57.865886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-9a9a85b7-f532-4816-a4f3-069d3c47ffde req-f8be22f3-a292-4f04-8153-0a4aea34d182 service nova] Creating event network-changed:14995843-d975-4a00-9ad9-746c61f720d5 for instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 on hv-cinder-80135 Jun 03 13:22:57.872619 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-9a9a85b7-f532-4816-a4f3-069d3c47ffde req-f8be22f3-a292-4f04-8153-0a4aea34d182 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040995 Jun 03 13:22:57.874407 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 90/227] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:22:57.879950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d6d79cc4-f533-4d73-ba10-c4643e425b79 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:57.889518 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d6d79cc4-f533-4d73-ba10-c4643e425b79 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.215932 Jun 03 13:22:57.891143 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 138/228] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:57 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:58.497905 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4a42d57f-7e2d-4989-b642-c2c8aaa2ea1b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:58.498607 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4a42d57f-7e2d-4989-b642-c2c8aaa2ea1b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:58.506139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4a42d57f-7e2d-4989-b642-c2c8aaa2ea1b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:58.506753 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4a42d57f-7e2d-4989-b642-c2c8aaa2ea1b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:58.507686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4a42d57f-7e2d-4989-b642-c2c8aaa2ea1b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:58.508294 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4a42d57f-7e2d-4989-b642-c2c8aaa2ea1b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:58.664490 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4a42d57f-7e2d-4989-b642-c2c8aaa2ea1b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:58.672338 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4a42d57f-7e2d-4989-b642-c2c8aaa2ea1b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1550 microversion: 2.1 time: 0.179474 Jun 03 13:22:58.672897 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 91/229] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:58 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1550 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:58.689316 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0be77ddf-1f69-446b-a0db-03db2255069d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:58.689845 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0be77ddf-1f69-446b-a0db-03db2255069d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:58.696034 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0be77ddf-1f69-446b-a0db-03db2255069d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:58.696520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0be77ddf-1f69-446b-a0db-03db2255069d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:58.697277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0be77ddf-1f69-446b-a0db-03db2255069d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:58.697828 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0be77ddf-1f69-446b-a0db-03db2255069d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:58.818853 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0be77ddf-1f69-446b-a0db-03db2255069d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133470 Jun 03 13:22:58.819447 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 139/230] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 13:22:58 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:22:58.841221 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-abab5c9a-1ebd-4e74-9c35-c092c44ae8fd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:58.841979 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-abab5c9a-1ebd-4e74-9c35-c092c44ae8fd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:58.849037 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-abab5c9a-1ebd-4e74-9c35-c092c44ae8fd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:58.849609 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-abab5c9a-1ebd-4e74-9c35-c092c44ae8fd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:58.850652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-abab5c9a-1ebd-4e74-9c35-c092c44ae8fd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:58.851186 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-abab5c9a-1ebd-4e74-9c35-c092c44ae8fd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:58.908326 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4b9b8fc3-618b-439a-a5e7-7f9c72954362 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:22:58.909265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4b9b8fc3-618b-439a-a5e7-7f9c72954362 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:22:58.916630 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fc3-618b-439a-a5e7-7f9c72954362 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:58.917506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fc3-618b-439a-a5e7-7f9c72954362 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:58.918503 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fc3-618b-439a-a5e7-7f9c72954362 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:58.919861 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4b9b8fc3-618b-439a-a5e7-7f9c72954362 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:59.006900 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-abab5c9a-1ebd-4e74-9c35-c092c44ae8fd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:59.014486 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-abab5c9a-1ebd-4e74-9c35-c092c44ae8fd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.177464 Jun 03 13:22:59.015732 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 92/231] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:58 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:22:59.153894 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4b9b8fc3-618b-439a-a5e7-7f9c72954362 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:22:59.161960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4b9b8fc3-618b-439a-a5e7-7f9c72954362 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.258805 Jun 03 13:22:59.162548 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 140/232] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:22:58 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:22:59.889683 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-4a6ff049-110a-4513-b34e-3acfbf100d6e req-ff52507c-726c-4c30-8e70-fcc5ba822aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a334af7a-c5bb-4c6e-aa37-bb7c86b838c2", "tag": "77ec7712-763e-4c88-ad78-1277b03066fd"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:22:59.900252 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-4a6ff049-110a-4513-b34e-3acfbf100d6e req-ff52507c-726c-4c30-8e70-fcc5ba822aae service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:22:59.900695 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-4a6ff049-110a-4513-b34e-3acfbf100d6e req-ff52507c-726c-4c30-8e70-fcc5ba822aae service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:22:59.912257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-4a6ff049-110a-4513-b34e-3acfbf100d6e req-ff52507c-726c-4c30-8e70-fcc5ba822aae service nova] Creating event network-changed:77ec7712-763e-4c88-ad78-1277b03066fd for instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 on hv-cinder-80135 Jun 03 13:22:59.917303 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-4a6ff049-110a-4513-b34e-3acfbf100d6e req-ff52507c-726c-4c30-8e70-fcc5ba822aae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031337 Jun 03 13:22:59.918057 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 93/233] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:00.031938 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2edf3998-9444-4c1c-86ef-56b23c517e78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:00.033129 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2edf3998-9444-4c1c-86ef-56b23c517e78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:00.038681 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2edf3998-9444-4c1c-86ef-56b23c517e78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:00.039140 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2edf3998-9444-4c1c-86ef-56b23c517e78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:00.039928 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2edf3998-9444-4c1c-86ef-56b23c517e78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:00.040396 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2edf3998-9444-4c1c-86ef-56b23c517e78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:00.171228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2edf3998-9444-4c1c-86ef-56b23c517e78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:00.179217 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2edf3998-9444-4c1c-86ef-56b23c517e78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.152273 Jun 03 13:23:00.179762 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8b6f200f-c75a-42a3-a7a8-9b6332fd9587 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:00.179911 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 141/234] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:00 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:00.180782 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8b6f200f-c75a-42a3-a7a8-9b6332fd9587 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:00.187398 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8b6f200f-c75a-42a3-a7a8-9b6332fd9587 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:00.187932 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8b6f200f-c75a-42a3-a7a8-9b6332fd9587 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:00.188803 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8b6f200f-c75a-42a3-a7a8-9b6332fd9587 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:00.189370 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8b6f200f-c75a-42a3-a7a8-9b6332fd9587 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:00.329796 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8b6f200f-c75a-42a3-a7a8-9b6332fd9587 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:00.337266 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8b6f200f-c75a-42a3-a7a8-9b6332fd9587 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.162150 Jun 03 13:23:00.337837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 94/235] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:00 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:01.196234 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-47370bf3-7131-404e-b62a-4b8de4c5d32e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:01.196764 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-47370bf3-7131-404e-b62a-4b8de4c5d32e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:01.203475 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47370bf3-7131-404e-b62a-4b8de4c5d32e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:01.203922 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47370bf3-7131-404e-b62a-4b8de4c5d32e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:01.204701 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47370bf3-7131-404e-b62a-4b8de4c5d32e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:01.205139 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47370bf3-7131-404e-b62a-4b8de4c5d32e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:01.330875 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-47370bf3-7131-404e-b62a-4b8de4c5d32e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:01.338290 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-47370bf3-7131-404e-b62a-4b8de4c5d32e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.145978 Jun 03 13:23:01.338837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 142/236] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:01 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:01.354110 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a2438c67-1be5-45cf-b2f7-6ffaad608eef tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:01.354713 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a2438c67-1be5-45cf-b2f7-6ffaad608eef tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:01.361374 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a2438c67-1be5-45cf-b2f7-6ffaad608eef tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:01.361814 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a2438c67-1be5-45cf-b2f7-6ffaad608eef tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:01.362560 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a2438c67-1be5-45cf-b2f7-6ffaad608eef tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:01.362992 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a2438c67-1be5-45cf-b2f7-6ffaad608eef tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:01.488084 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a2438c67-1be5-45cf-b2f7-6ffaad608eef tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:01.495703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a2438c67-1be5-45cf-b2f7-6ffaad608eef tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.145483 Jun 03 13:23:01.496275 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 95/237] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:01 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:02.354809 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-99d25faf-050d-47df-aeea-9de6d33488f6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:02.355419 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-99d25faf-050d-47df-aeea-9de6d33488f6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:02.362679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-99d25faf-050d-47df-aeea-9de6d33488f6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:02.363117 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-99d25faf-050d-47df-aeea-9de6d33488f6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:02.363893 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-99d25faf-050d-47df-aeea-9de6d33488f6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:02.364380 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-99d25faf-050d-47df-aeea-9de6d33488f6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:02.494892 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-99d25faf-050d-47df-aeea-9de6d33488f6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:02.502391 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-99d25faf-050d-47df-aeea-9de6d33488f6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1367 microversion: 2.1 time: 0.151538 Jun 03 13:23:02.502959 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 143/238] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:02 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:02.512922 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6efbef6e-c86f-4fad-8428-d24196eda602 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:02.515202 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6efbef6e-c86f-4fad-8428-d24196eda602 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:02.521088 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6efbef6e-c86f-4fad-8428-d24196eda602 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:02.521545 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6efbef6e-c86f-4fad-8428-d24196eda602 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:02.522310 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6efbef6e-c86f-4fad-8428-d24196eda602 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:02.522748 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6efbef6e-c86f-4fad-8428-d24196eda602 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:02.656050 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6efbef6e-c86f-4fad-8428-d24196eda602 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:02.664895 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6efbef6e-c86f-4fad-8428-d24196eda602 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.155758 Jun 03 13:23:02.665463 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 96/239] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:02 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:03.519280 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-72c22064-7377-4136-b1ae-589b74d5ce78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:03.519950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-72c22064-7377-4136-b1ae-589b74d5ce78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:03.525992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-72c22064-7377-4136-b1ae-589b74d5ce78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:03.526477 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-72c22064-7377-4136-b1ae-589b74d5ce78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:03.527244 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-72c22064-7377-4136-b1ae-589b74d5ce78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:03.527670 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-72c22064-7377-4136-b1ae-589b74d5ce78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:03.658149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-72c22064-7377-4136-b1ae-589b74d5ce78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:03.667538 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-72c22064-7377-4136-b1ae-589b74d5ce78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1558 microversion: 2.1 time: 0.152659 Jun 03 13:23:03.679744 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 144/240] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:03 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:03.685217 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-999f16ad-1735-46d6-980a-248a16fa31bf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:03.686059 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-999f16ad-1735-46d6-980a-248a16fa31bf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:03.686998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-50f14ead-094e-4454-af41-186acae0b6b7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:03.688312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-50f14ead-094e-4454-af41-186acae0b6b7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:03.694436 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-999f16ad-1735-46d6-980a-248a16fa31bf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:03.694882 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-999f16ad-1735-46d6-980a-248a16fa31bf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:03.695655 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-999f16ad-1735-46d6-980a-248a16fa31bf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:03.696082 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-999f16ad-1735-46d6-980a-248a16fa31bf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:03.697255 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-50f14ead-094e-4454-af41-186acae0b6b7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:03.697867 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-50f14ead-094e-4454-af41-186acae0b6b7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:03.699336 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-50f14ead-094e-4454-af41-186acae0b6b7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:03.701318 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-50f14ead-094e-4454-af41-186acae0b6b7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:03.776607 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-999f16ad-1735-46d6-980a-248a16fa31bf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095519 Jun 03 13:23:03.783673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 145/241] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 13:23:03 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:03.852180 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-50f14ead-094e-4454-af41-186acae0b6b7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:03.863999 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-50f14ead-094e-4454-af41-186acae0b6b7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.182056 Jun 03 13:23:03.864399 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 97/242] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:03 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:23:04.881495 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-212a7c40-56c0-47d7-b2bf-1f559fdff6a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:04.882260 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-212a7c40-56c0-47d7-b2bf-1f559fdff6a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:04.888473 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-212a7c40-56c0-47d7-b2bf-1f559fdff6a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:04.888919 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-212a7c40-56c0-47d7-b2bf-1f559fdff6a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:04.889696 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-212a7c40-56c0-47d7-b2bf-1f559fdff6a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:04.890126 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-212a7c40-56c0-47d7-b2bf-1f559fdff6a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:05.052806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-18fbab09-bd9e-4e04-8494-cefbdce228d4 req-ec8f7449-43d7-4201-95d8-b35d5666d4ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f916e17-eccc-4c6d-b3cd-9517056abcfc", "tag": "24f2a109-5081-4497-ba6a-88eaca5fa11c"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:23:05.064751 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-18fbab09-bd9e-4e04-8494-cefbdce228d4 req-ec8f7449-43d7-4201-95d8-b35d5666d4ea service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:05.065224 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-18fbab09-bd9e-4e04-8494-cefbdce228d4 req-ec8f7449-43d7-4201-95d8-b35d5666d4ea service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:05.077901 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-212a7c40-56c0-47d7-b2bf-1f559fdff6a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:05.088760 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-212a7c40-56c0-47d7-b2bf-1f559fdff6a8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.210760 Jun 03 13:23:05.088964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 146/243] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:04 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:05.090518 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-18fbab09-bd9e-4e04-8494-cefbdce228d4 req-ec8f7449-43d7-4201-95d8-b35d5666d4ea service nova] Creating event network-changed:24f2a109-5081-4497-ba6a-88eaca5fa11c for instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc on hv-cinder-80135 Jun 03 13:23:05.096593 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-18fbab09-bd9e-4e04-8494-cefbdce228d4 req-ec8f7449-43d7-4201-95d8-b35d5666d4ea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047622 Jun 03 13:23:05.097347 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 98/244] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:06.106330 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-bda677e1-8869-4588-9d63-97cc13fbf6f9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:06.106903 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-bda677e1-8869-4588-9d63-97cc13fbf6f9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:06.113399 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bda677e1-8869-4588-9d63-97cc13fbf6f9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:06.113846 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bda677e1-8869-4588-9d63-97cc13fbf6f9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:06.114616 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bda677e1-8869-4588-9d63-97cc13fbf6f9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:06.115042 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bda677e1-8869-4588-9d63-97cc13fbf6f9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:06.251428 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-bda677e1-8869-4588-9d63-97cc13fbf6f9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:06.259205 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-bda677e1-8869-4588-9d63-97cc13fbf6f9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.156615 Jun 03 13:23:06.259705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 147/245] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:06 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:07.276717 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-71170fb3-2391-4ad6-a23c-4325b5ae6062 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:07.277410 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-71170fb3-2391-4ad6-a23c-4325b5ae6062 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:07.285054 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-71170fb3-2391-4ad6-a23c-4325b5ae6062 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:07.285507 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-71170fb3-2391-4ad6-a23c-4325b5ae6062 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:07.286264 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-71170fb3-2391-4ad6-a23c-4325b5ae6062 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:07.286833 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-71170fb3-2391-4ad6-a23c-4325b5ae6062 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:07.433575 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-71170fb3-2391-4ad6-a23c-4325b5ae6062 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:07.442139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-71170fb3-2391-4ad6-a23c-4325b5ae6062 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.169523 Jun 03 13:23:07.443863 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 99/246] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:07 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:08.459711 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2cfafe5e-35de-4061-9f2b-c97c2df4b61f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:08.461045 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2cfafe5e-35de-4061-9f2b-c97c2df4b61f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:08.469147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2cfafe5e-35de-4061-9f2b-c97c2df4b61f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:08.470127 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2cfafe5e-35de-4061-9f2b-c97c2df4b61f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:08.471140 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2cfafe5e-35de-4061-9f2b-c97c2df4b61f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:08.471766 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2cfafe5e-35de-4061-9f2b-c97c2df4b61f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:08.603576 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2cfafe5e-35de-4061-9f2b-c97c2df4b61f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:08.611596 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2cfafe5e-35de-4061-9f2b-c97c2df4b61f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1321 microversion: 2.1 time: 0.156388 Jun 03 13:23:08.612245 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 148/247] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:08 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:09.630017 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-07ef19ca-3d75-4206-8dc0-f2981df5b01f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:09.630552 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-07ef19ca-3d75-4206-8dc0-f2981df5b01f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:09.637150 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-07ef19ca-3d75-4206-8dc0-f2981df5b01f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:09.637606 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-07ef19ca-3d75-4206-8dc0-f2981df5b01f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:09.638366 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-07ef19ca-3d75-4206-8dc0-f2981df5b01f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:09.638806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-07ef19ca-3d75-4206-8dc0-f2981df5b01f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:09.775697 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-07ef19ca-3d75-4206-8dc0-f2981df5b01f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:09.787402 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-07ef19ca-3d75-4206-8dc0-f2981df5b01f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1516 microversion: 2.1 time: 0.161912 Jun 03 13:23:09.787981 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 100/248] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:09 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:09.810784 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9ba3418f-9175-409a-ad4e-db8727b90ad2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:23:09.814176 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9ba3418f-9175-409a-ad4e-db8727b90ad2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:09.823163 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9ba3418f-9175-409a-ad4e-db8727b90ad2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:09.823646 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9ba3418f-9175-409a-ad4e-db8727b90ad2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:09.824452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9ba3418f-9175-409a-ad4e-db8727b90ad2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:09.824886 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9ba3418f-9175-409a-ad4e-db8727b90ad2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:09.850025 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-9ba3418f-9175-409a-ad4e-db8727b90ad2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lazy-loading 'flavor' on Instance uuid 2968dd86-2754-4322-aae8-39fa37b9826f {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:23:10.316313 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9ba3418f-9175-409a-ad4e-db8727b90ad2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "POST /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f/action" status: 200 len: 32 microversion: 2.1 time: 0.513449 Jun 03 13:23:10.316920 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 149/249] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:23:09 2022] POST /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f/action => generated 32 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:23:10.325846 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6750ea7c-531e-4070-ac23-fca995893975 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:10.326461 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6750ea7c-531e-4070-ac23-fca995893975 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:10.332986 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6750ea7c-531e-4070-ac23-fca995893975 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:10.333440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6750ea7c-531e-4070-ac23-fca995893975 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:10.334207 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6750ea7c-531e-4070-ac23-fca995893975 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:10.334647 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6750ea7c-531e-4070-ac23-fca995893975 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:10.462634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6750ea7c-531e-4070-ac23-fca995893975 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:10.470775 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6750ea7c-531e-4070-ac23-fca995893975 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.148773 Jun 03 13:23:10.471491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 101/250] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:10 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:11.489966 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-292cb71e-b0ab-4d27-b638-a573aa142064 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:11.491197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-292cb71e-b0ab-4d27-b638-a573aa142064 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:11.498412 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-292cb71e-b0ab-4d27-b638-a573aa142064 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:11.498860 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-292cb71e-b0ab-4d27-b638-a573aa142064 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:11.499616 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-292cb71e-b0ab-4d27-b638-a573aa142064 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:11.500900 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-292cb71e-b0ab-4d27-b638-a573aa142064 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:11.631097 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-292cb71e-b0ab-4d27-b638-a573aa142064 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:11.638542 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-292cb71e-b0ab-4d27-b638-a573aa142064 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.154403 Jun 03 13:23:11.639146 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 150/251] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:11 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:12.654738 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9f232f60-ca43-42e0-894f-9302c98bc8f4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:12.655344 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-9f232f60-ca43-42e0-894f-9302c98bc8f4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:12.661920 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9f232f60-ca43-42e0-894f-9302c98bc8f4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:12.662425 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9f232f60-ca43-42e0-894f-9302c98bc8f4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:12.663195 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9f232f60-ca43-42e0-894f-9302c98bc8f4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:12.663614 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9f232f60-ca43-42e0-894f-9302c98bc8f4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:12.793647 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9f232f60-ca43-42e0-894f-9302c98bc8f4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:12.801990 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9f232f60-ca43-42e0-894f-9302c98bc8f4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.151111 Jun 03 13:23:12.802560 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 102/252] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:12 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:13.819694 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e68d0903-8ee9-4f2a-9213-79a004bc8e66 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:13.820445 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e68d0903-8ee9-4f2a-9213-79a004bc8e66 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:13.826750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e68d0903-8ee9-4f2a-9213-79a004bc8e66 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:13.827209 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e68d0903-8ee9-4f2a-9213-79a004bc8e66 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:13.828073 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e68d0903-8ee9-4f2a-9213-79a004bc8e66 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:13.828616 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e68d0903-8ee9-4f2a-9213-79a004bc8e66 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:13.961237 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e68d0903-8ee9-4f2a-9213-79a004bc8e66 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:13.969240 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e68d0903-8ee9-4f2a-9213-79a004bc8e66 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.153262 Jun 03 13:23:13.969805 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 151/253] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:13 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:14.986887 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8a97f78a-d04d-48b7-8e3f-d23dcb0c85e1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:14.988273 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8a97f78a-d04d-48b7-8e3f-d23dcb0c85e1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:14.991639 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=65 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:14.997327 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8a97f78a-d04d-48b7-8e3f-d23dcb0c85e1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:15.000697 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8a97f78a-d04d-48b7-8e3f-d23dcb0c85e1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:15.000697 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8a97f78a-d04d-48b7-8e3f-d23dcb0c85e1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:15.000697 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8a97f78a-d04d-48b7-8e3f-d23dcb0c85e1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:15.136879 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8a97f78a-d04d-48b7-8e3f-d23dcb0c85e1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:15.147224 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8a97f78a-d04d-48b7-8e3f-d23dcb0c85e1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.165017 Jun 03 13:23:15.147812 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 103/254] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:14 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:16.174386 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4e2dcc51-385e-4727-8e2b-d39b31fb7552 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:16.176313 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4e2dcc51-385e-4727-8e2b-d39b31fb7552 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:16.189452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=76 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:16.191990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4e2dcc51-385e-4727-8e2b-d39b31fb7552 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:16.193551 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4e2dcc51-385e-4727-8e2b-d39b31fb7552 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:16.194948 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4e2dcc51-385e-4727-8e2b-d39b31fb7552 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:16.196521 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4e2dcc51-385e-4727-8e2b-d39b31fb7552 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:16.582990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4e2dcc51-385e-4727-8e2b-d39b31fb7552 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:16.590421 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4e2dcc51-385e-4727-8e2b-d39b31fb7552 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.427861 Jun 03 13:23:16.591187 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 152/255] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:16 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:16.856671 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-05a0a6fb-7c8b-48d1-904e-347d35f0a699 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:16.857238 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-05a0a6fb-7c8b-48d1-904e-347d35f0a699 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:16.863640 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-05a0a6fb-7c8b-48d1-904e-347d35f0a699 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:16.864086 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-05a0a6fb-7c8b-48d1-904e-347d35f0a699 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:16.864880 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-05a0a6fb-7c8b-48d1-904e-347d35f0a699 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:16.865315 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-05a0a6fb-7c8b-48d1-904e-347d35f0a699 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:16.891715 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-05a0a6fb-7c8b-48d1-904e-347d35f0a699 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Going to try to terminate instance {{(pid=118178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:23:16.937109 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:17.221013 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-05a0a6fb-7c8b-48d1-904e-347d35f0a699 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 204 len: 0 microversion: 2.1 time: 0.367809 Jun 03 13:23:17.221596 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 104/256] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:23:16 2022] DELETE /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:23:17.237088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-84678314-fb22-424f-935f-e090309061ec tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:17.237752 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-84678314-fb22-424f-935f-e090309061ec tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:17.244041 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-84678314-fb22-424f-935f-e090309061ec tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:17.244530 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-84678314-fb22-424f-935f-e090309061ec tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:17.245299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-84678314-fb22-424f-935f-e090309061ec tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:17.245735 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-84678314-fb22-424f-935f-e090309061ec tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:17.248480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:17.435740 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-84678314-fb22-424f-935f-e090309061ec tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:17.445381 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-84678314-fb22-424f-935f-e090309061ec tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1553 microversion: 2.1 time: 0.213024 Jun 03 13:23:17.455343 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 153/257] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:17 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:17.609908 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-59246cdb-c730-46e3-86dd-598cf9ada5eb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:17.610917 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-59246cdb-c730-46e3-86dd-598cf9ada5eb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:17.617491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-59246cdb-c730-46e3-86dd-598cf9ada5eb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:17.617947 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-59246cdb-c730-46e3-86dd-598cf9ada5eb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:17.618968 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-59246cdb-c730-46e3-86dd-598cf9ada5eb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:17.619411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-59246cdb-c730-46e3-86dd-598cf9ada5eb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:17.762179 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-59246cdb-c730-46e3-86dd-598cf9ada5eb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:17.774005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-59246cdb-c730-46e3-86dd-598cf9ada5eb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.169180 Jun 03 13:23:17.774938 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 105/258] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:17 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:18.462851 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e32075b3-28b5-4449-8e87-9cc96192ff2e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:18.463642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e32075b3-28b5-4449-8e87-9cc96192ff2e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:18.470169 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e32075b3-28b5-4449-8e87-9cc96192ff2e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:18.474381 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e32075b3-28b5-4449-8e87-9cc96192ff2e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:18.474381 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e32075b3-28b5-4449-8e87-9cc96192ff2e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:18.474381 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e32075b3-28b5-4449-8e87-9cc96192ff2e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:18.626004 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e32075b3-28b5-4449-8e87-9cc96192ff2e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:18.645222 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e32075b3-28b5-4449-8e87-9cc96192ff2e tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1553 microversion: 2.1 time: 0.185859 Jun 03 13:23:18.646489 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 154/259] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:18 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:23:18.795929 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-82c9a2c6-c6c8-44af-9ed6-6306e820a3d0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:18.797184 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-82c9a2c6-c6c8-44af-9ed6-6306e820a3d0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:18.805087 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-82c9a2c6-c6c8-44af-9ed6-6306e820a3d0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:18.805679 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-82c9a2c6-c6c8-44af-9ed6-6306e820a3d0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:18.806591 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-82c9a2c6-c6c8-44af-9ed6-6306e820a3d0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:18.807162 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-82c9a2c6-c6c8-44af-9ed6-6306e820a3d0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:18.969329 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-82c9a2c6-c6c8-44af-9ed6-6306e820a3d0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:18.977092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-82c9a2c6-c6c8-44af-9ed6-6306e820a3d0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.189370 Jun 03 13:23:18.978145 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 106/260] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:18 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:19.664103 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-460ce36e-a038-4ef5-832d-01250b45d0d3 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:19.664759 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-460ce36e-a038-4ef5-832d-01250b45d0d3 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:19.670742 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-460ce36e-a038-4ef5-832d-01250b45d0d3 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:19.671266 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-460ce36e-a038-4ef5-832d-01250b45d0d3 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:19.672337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-460ce36e-a038-4ef5-832d-01250b45d0d3 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:19.672630 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-460ce36e-a038-4ef5-832d-01250b45d0d3 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:19.813824 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-460ce36e-a038-4ef5-832d-01250b45d0d3 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:19.828936 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-460ce36e-a038-4ef5-832d-01250b45d0d3 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1553 microversion: 2.1 time: 0.169052 Jun 03 13:23:19.829852 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 155/261] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:19 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:19.996833 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-31532a26-54fe-4235-9d03-c88b17a8ad01 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:19.998287 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-31532a26-54fe-4235-9d03-c88b17a8ad01 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:20.006571 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-31532a26-54fe-4235-9d03-c88b17a8ad01 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:20.007416 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-31532a26-54fe-4235-9d03-c88b17a8ad01 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:20.008256 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-31532a26-54fe-4235-9d03-c88b17a8ad01 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:20.008768 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-31532a26-54fe-4235-9d03-c88b17a8ad01 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:20.227032 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-31532a26-54fe-4235-9d03-c88b17a8ad01 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:20.235628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-31532a26-54fe-4235-9d03-c88b17a8ad01 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.244439 Jun 03 13:23:20.236221 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 107/262] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:19 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:20.772909 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-258f0347-db56-403c-874d-a73d78fd7f75 req-fb0e06ea-222e-45cd-9a80-db960090cea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec28c8c-6e08-42ec-ac43-6f502db967c0", "name": "network-vif-deleted", "tag": "82a9c545-3bd3-4d02-8e78-ee2312428fcd"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:23:20.780884 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-258f0347-db56-403c-874d-a73d78fd7f75 req-fb0e06ea-222e-45cd-9a80-db960090cea6 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:20.781908 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-258f0347-db56-403c-874d-a73d78fd7f75 req-fb0e06ea-222e-45cd-9a80-db960090cea6 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:20.793022 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-258f0347-db56-403c-874d-a73d78fd7f75 req-fb0e06ea-222e-45cd-9a80-db960090cea6 service nova] Creating event network-vif-deleted:82a9c545-3bd3-4d02-8e78-ee2312428fcd for instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 on hv-cinder-80135 Jun 03 13:23:20.799594 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-258f0347-db56-403c-874d-a73d78fd7f75 req-fb0e06ea-222e-45cd-9a80-db960090cea6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030287 Jun 03 13:23:20.800212 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 156/263] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:23:20.846549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-900f67f0-4a1a-4edf-a5d1-70f8691c58d4 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:20.847161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-900f67f0-4a1a-4edf-a5d1-70f8691c58d4 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:20.854193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-900f67f0-4a1a-4edf-a5d1-70f8691c58d4 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:20.854642 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-900f67f0-4a1a-4edf-a5d1-70f8691c58d4 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:20.855464 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-900f67f0-4a1a-4edf-a5d1-70f8691c58d4 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:20.855901 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-900f67f0-4a1a-4edf-a5d1-70f8691c58d4 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:20.919756 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-900f67f0-4a1a-4edf-a5d1-70f8691c58d4 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:20.928539 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-900f67f0-4a1a-4edf-a5d1-70f8691c58d4 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1511 microversion: 2.1 time: 0.086554 Jun 03 13:23:20.929100 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 108/264] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:20 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1511 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:21.252895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-55fdd01d-4909-42e5-ba12-42d7a1621fbf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:21.253582 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-55fdd01d-4909-42e5-ba12-42d7a1621fbf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:21.259823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-55fdd01d-4909-42e5-ba12-42d7a1621fbf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:21.260243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-55fdd01d-4909-42e5-ba12-42d7a1621fbf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:21.261007 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-55fdd01d-4909-42e5-ba12-42d7a1621fbf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:21.261449 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-55fdd01d-4909-42e5-ba12-42d7a1621fbf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:21.391777 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-55fdd01d-4909-42e5-ba12-42d7a1621fbf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:21.399693 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-55fdd01d-4909-42e5-ba12-42d7a1621fbf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.151004 Jun 03 13:23:21.400307 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 157/265] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:21 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:21.945612 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-19ccfa33-0a1e-480c-bb41-f3f2d28a7f51 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:21.946224 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-19ccfa33-0a1e-480c-bb41-f3f2d28a7f51 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:21.953728 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19ccfa33-0a1e-480c-bb41-f3f2d28a7f51 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:21.954281 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19ccfa33-0a1e-480c-bb41-f3f2d28a7f51 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:21.955051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19ccfa33-0a1e-480c-bb41-f3f2d28a7f51 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:21.955481 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19ccfa33-0a1e-480c-bb41-f3f2d28a7f51 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:21.995697 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19ccfa33-0a1e-480c-bb41-f3f2d28a7f51 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:21.996162 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19ccfa33-0a1e-480c-bb41-f3f2d28a7f51 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:21.996650 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-19ccfa33-0a1e-480c-bb41-f3f2d28a7f51 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lazy-loading 'fault' on Instance uuid 6ec28c8c-6e08-42ec-ac43-6f502db967c0 {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:23:22.043782 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-19ccfa33-0a1e-480c-bb41-f3f2d28a7f51 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144789e582de45c280d03b92dee5692a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6909571f8274f4ebf822ce71cd43c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:22.051759 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-19ccfa33-0a1e-480c-bb41-f3f2d28a7f51 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 200 len: 1350 microversion: 2.1 time: 0.110409 Jun 03 13:23:22.052344 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 109/266] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:21 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:22.416028 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c5f8f549-e7b5-4b36-a138-cb278ef51953 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:22.416666 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c5f8f549-e7b5-4b36-a138-cb278ef51953 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:22.422902 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c5f8f549-e7b5-4b36-a138-cb278ef51953 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:22.423353 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c5f8f549-e7b5-4b36-a138-cb278ef51953 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:22.424128 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c5f8f549-e7b5-4b36-a138-cb278ef51953 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:22.424598 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c5f8f549-e7b5-4b36-a138-cb278ef51953 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:22.570306 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c5f8f549-e7b5-4b36-a138-cb278ef51953 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:22.577631 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c5f8f549-e7b5-4b36-a138-cb278ef51953 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.165436 Jun 03 13:23:22.578303 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 158/267] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:22 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:23.069505 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-21391ef6-f93c-4326-b951-7a3ad53135a2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:23.070582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-21391ef6-f93c-4326-b951-7a3ad53135a2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:23.079971 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-21391ef6-f93c-4326-b951-7a3ad53135a2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.080444 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-21391ef6-f93c-4326-b951-7a3ad53135a2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.081251 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-21391ef6-f93c-4326-b951-7a3ad53135a2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.081685 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-21391ef6-f93c-4326-b951-7a3ad53135a2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.094885 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-21391ef6-f93c-4326-b951-7a3ad53135a2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] HTTP exception thrown: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-21391ef6-f93c-4326-b951-7a3ad53135a2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Request method failure captured: Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 HTTP/1.1 Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgroitXW9BnhZATLWtlz72f62zhyYqq2aeSdR11RoEcEWcRZ2KSmLZHKnNT3SL6EEOVWqjpwMXsF7He-_SFlbHDa0Hp4RaF_E89or2YZSFFRIQvRmN9RttxzGzgMtpTCntsYB3GvjA3TBy9jaUMvWcnx6k5uUoCEF0pCNX-D5nkolnI Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: f6909571f8274f4ebf822ce71cd43c2b Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-DeleteServersTestJSON-1590599138 Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:23:23.099574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:23:23.101051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6909571f8274f4ebf822ce71cd43c2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6909571f8274f4ebf822ce71cd43c2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6909571f8274f4ebf822ce71cd43c2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6909571f8274f4ebf822ce71cd43c2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:23:23.101051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-DeleteServersTestJSON-1590599138 Jun 03 13:23:23.101051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: f6909571f8274f4ebf822ce71cd43c2b Jun 03 13:23:23.101051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-DeleteServersTestJSON-1590599138 Jun 03 13:23:23.101051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-DeleteServersTestJSON-1590599138-project Jun 03 13:23:23.101051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:23:23.101051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:23:23.101051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 144789e582de45c280d03b92dee5692a Jun 03 13:23:23.101051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-DeleteServersTestJSON-1590599138-project Jun 03 13:23:23.101051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:23:23.101051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:23.101051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '6ec28c8c-6e08-42ec-ac43-6f502db967c0'} Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:23.101964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:23.103367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:23:23.104634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-21391ef6-f93c-4326-b951-7a3ad53135a2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Returning 404 to user: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:23.104634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-21391ef6-f93c-4326-b951-7a3ad53135a2 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 404 len: 111 microversion: 2.1 time: 0.035466 Jun 03 13:23:23.104634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 110/268] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:23 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:23:23.264120 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-216d74f3-8e34-40d4-b1ed-38bc34f4938a tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:23.265069 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-216d74f3-8e34-40d4-b1ed-38bc34f4938a tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:23.272323 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-216d74f3-8e34-40d4-b1ed-38bc34f4938a tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.272775 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-216d74f3-8e34-40d4-b1ed-38bc34f4938a tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.273545 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-216d74f3-8e34-40d4-b1ed-38bc34f4938a tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.273984 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-216d74f3-8e34-40d4-b1ed-38bc34f4938a tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.289386 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-216d74f3-8e34-40d4-b1ed-38bc34f4938a tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] HTTP exception thrown: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-216d74f3-8e34-40d4-b1ed-38bc34f4938a tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Request method failure captured: Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0/os-volume_attachments HTTP/1.1 Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgroitXW9BnhZATLWtlz72f62zhyYqq2aeSdR11RoEcEWcRZ2KSmLZHKnNT3SL6EEOVWqjpwMXsF7He-_SFlbHDa0Hp4RaF_E89or2YZSFFRIQvRmN9RttxzGzgMtpTCntsYB3GvjA3TBy9jaUMvWcnx6k5uUoCEF0pCNX-D5nkolnI Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: f6909571f8274f4ebf822ce71cd43c2b Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-DeleteServersTestJSON-1590599138 Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:23:23.293520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:23:23.301055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6909571f8274f4ebf822ce71cd43c2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6909571f8274f4ebf822ce71cd43c2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6909571f8274f4ebf822ce71cd43c2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6909571f8274f4ebf822ce71cd43c2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:23:23.301055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-DeleteServersTestJSON-1590599138 Jun 03 13:23:23.301055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: f6909571f8274f4ebf822ce71cd43c2b Jun 03 13:23:23.301055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-DeleteServersTestJSON-1590599138 Jun 03 13:23:23.301055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-DeleteServersTestJSON-1590599138-project Jun 03 13:23:23.301055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:23:23.301055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:23:23.301055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 144789e582de45c280d03b92dee5692a Jun 03 13:23:23.301055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-DeleteServersTestJSON-1590599138-project Jun 03 13:23:23.301055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:23:23.301055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:23.301055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'server_id': '6ec28c8c-6e08-42ec-ac43-6f502db967c0'} Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:23.302080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:23.303422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:23.304886 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-216d74f3-8e34-40d4-b1ed-38bc34f4938a tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Returning 404 to user: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:23.304886 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-216d74f3-8e34-40d4-b1ed-38bc34f4938a tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035226 Jun 03 13:23:23.304886 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 159/269] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:23:23 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:23:23.594978 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-55a26a47-313a-4b51-b3fd-99e7f0214b44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:23.596612 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-55a26a47-313a-4b51-b3fd-99e7f0214b44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:23.603323 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-55a26a47-313a-4b51-b3fd-99e7f0214b44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.603789 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-55a26a47-313a-4b51-b3fd-99e7f0214b44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.604584 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-55a26a47-313a-4b51-b3fd-99e7f0214b44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.605043 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-55a26a47-313a-4b51-b3fd-99e7f0214b44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.742215 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-55a26a47-313a-4b51-b3fd-99e7f0214b44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:23.750280 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-55a26a47-313a-4b51-b3fd-99e7f0214b44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.159412 Jun 03 13:23:23.750909 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 111/270] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:23 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:24.768457 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8d7edda2-b9f3-4bb4-a330-d6cb752be174 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:24.775653 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8d7edda2-b9f3-4bb4-a330-d6cb752be174 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:24.775653 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8d7edda2-b9f3-4bb4-a330-d6cb752be174 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:24.775653 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8d7edda2-b9f3-4bb4-a330-d6cb752be174 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:24.776496 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8d7edda2-b9f3-4bb4-a330-d6cb752be174 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:24.776930 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8d7edda2-b9f3-4bb4-a330-d6cb752be174 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:24.904727 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8d7edda2-b9f3-4bb4-a330-d6cb752be174 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:24.911987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8d7edda2-b9f3-4bb4-a330-d6cb752be174 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.147650 Jun 03 13:23:24.912571 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 160/271] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:24 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:25.930007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-fe1c512f-af4f-46b0-ab02-a9196af7476e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:25.930614 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-fe1c512f-af4f-46b0-ab02-a9196af7476e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:25.937108 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fe1c512f-af4f-46b0-ab02-a9196af7476e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:25.938053 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fe1c512f-af4f-46b0-ab02-a9196af7476e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:25.938885 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fe1c512f-af4f-46b0-ab02-a9196af7476e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:25.939319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fe1c512f-af4f-46b0-ab02-a9196af7476e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:26.064557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-fe1c512f-af4f-46b0-ab02-a9196af7476e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:26.071965 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-fe1c512f-af4f-46b0-ab02-a9196af7476e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.145812 Jun 03 13:23:26.072565 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 112/272] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:25 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:27.090185 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-77781a96-1b9c-4fa0-a4ab-d508befc2292 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:27.090790 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-77781a96-1b9c-4fa0-a4ab-d508befc2292 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:27.097534 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-77781a96-1b9c-4fa0-a4ab-d508befc2292 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:27.097984 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-77781a96-1b9c-4fa0-a4ab-d508befc2292 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:27.098746 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-77781a96-1b9c-4fa0-a4ab-d508befc2292 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:27.099177 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-77781a96-1b9c-4fa0-a4ab-d508befc2292 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:27.229885 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-77781a96-1b9c-4fa0-a4ab-d508befc2292 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:27.237213 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-77781a96-1b9c-4fa0-a4ab-d508befc2292 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.150888 Jun 03 13:23:27.237767 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 161/273] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:27 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:28.254055 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e2ae54e1-c174-41c4-bfcd-12f86da1f22d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:28.254696 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e2ae54e1-c174-41c4-bfcd-12f86da1f22d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:28.261662 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e2ae54e1-c174-41c4-bfcd-12f86da1f22d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:28.262118 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e2ae54e1-c174-41c4-bfcd-12f86da1f22d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:28.262896 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e2ae54e1-c174-41c4-bfcd-12f86da1f22d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:28.263377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e2ae54e1-c174-41c4-bfcd-12f86da1f22d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:28.398704 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e2ae54e1-c174-41c4-bfcd-12f86da1f22d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:28.408465 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e2ae54e1-c174-41c4-bfcd-12f86da1f22d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.155874 Jun 03 13:23:28.408465 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 113/274] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:28 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:29.423932 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-291dfb0c-2f14-4949-8d17-cb05c6804aba tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:29.424606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-291dfb0c-2f14-4949-8d17-cb05c6804aba tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:29.430586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-291dfb0c-2f14-4949-8d17-cb05c6804aba tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:29.431037 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-291dfb0c-2f14-4949-8d17-cb05c6804aba tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:29.431822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-291dfb0c-2f14-4949-8d17-cb05c6804aba tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:29.432286 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-291dfb0c-2f14-4949-8d17-cb05c6804aba tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:29.560188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-291dfb0c-2f14-4949-8d17-cb05c6804aba tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:29.568214 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-291dfb0c-2f14-4949-8d17-cb05c6804aba tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.148698 Jun 03 13:23:29.568765 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 162/275] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:29 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:30.585218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-bdc1f6f4-9c05-43f7-a9a8-af0696bb7274 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:30.585753 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-bdc1f6f4-9c05-43f7-a9a8-af0696bb7274 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:30.592189 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bdc1f6f4-9c05-43f7-a9a8-af0696bb7274 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:30.592632 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bdc1f6f4-9c05-43f7-a9a8-af0696bb7274 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:30.593441 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bdc1f6f4-9c05-43f7-a9a8-af0696bb7274 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:30.593975 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bdc1f6f4-9c05-43f7-a9a8-af0696bb7274 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:30.721691 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-bdc1f6f4-9c05-43f7-a9a8-af0696bb7274 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:30.731810 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-bdc1f6f4-9c05-43f7-a9a8-af0696bb7274 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.150571 Jun 03 13:23:30.732417 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 114/276] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:30 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:31.750333 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-db0f18e2-8eef-44e9-be80-9bfb94286ec5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:31.750937 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-db0f18e2-8eef-44e9-be80-9bfb94286ec5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:31.757058 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-db0f18e2-8eef-44e9-be80-9bfb94286ec5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:31.757544 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-db0f18e2-8eef-44e9-be80-9bfb94286ec5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:31.758335 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-db0f18e2-8eef-44e9-be80-9bfb94286ec5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:31.758773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-db0f18e2-8eef-44e9-be80-9bfb94286ec5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:31.884514 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-db0f18e2-8eef-44e9-be80-9bfb94286ec5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:31.891902 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-db0f18e2-8eef-44e9-be80-9bfb94286ec5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.146125 Jun 03 13:23:31.892488 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 163/277] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:31 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:32.908614 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dc7d63b8-c639-4027-a704-8816d3a47513 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:32.909216 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dc7d63b8-c639-4027-a704-8816d3a47513 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:32.915182 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dc7d63b8-c639-4027-a704-8816d3a47513 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:32.915628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dc7d63b8-c639-4027-a704-8816d3a47513 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:32.916420 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dc7d63b8-c639-4027-a704-8816d3a47513 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:32.916849 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dc7d63b8-c639-4027-a704-8816d3a47513 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:33.047675 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-dc7d63b8-c639-4027-a704-8816d3a47513 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:33.055440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dc7d63b8-c639-4027-a704-8816d3a47513 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.150843 Jun 03 13:23:33.056017 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 115/278] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:32 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:34.072430 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4bb29519-0626-42e8-8cda-64887bd71e0d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:34.073042 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4bb29519-0626-42e8-8cda-64887bd71e0d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:34.079653 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4bb29519-0626-42e8-8cda-64887bd71e0d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:34.080100 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4bb29519-0626-42e8-8cda-64887bd71e0d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:34.080888 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4bb29519-0626-42e8-8cda-64887bd71e0d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:34.081326 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4bb29519-0626-42e8-8cda-64887bd71e0d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:34.221227 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4bb29519-0626-42e8-8cda-64887bd71e0d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:34.230135 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4bb29519-0626-42e8-8cda-64887bd71e0d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.160661 Jun 03 13:23:34.230717 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 164/279] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:34 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:35.247618 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ab23ab69-6d41-4015-bdb4-db2fb64141b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:35.248245 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ab23ab69-6d41-4015-bdb4-db2fb64141b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:35.255181 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab23ab69-6d41-4015-bdb4-db2fb64141b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:35.255885 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab23ab69-6d41-4015-bdb4-db2fb64141b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:35.256673 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab23ab69-6d41-4015-bdb4-db2fb64141b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:35.257105 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab23ab69-6d41-4015-bdb4-db2fb64141b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:35.395433 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ab23ab69-6d41-4015-bdb4-db2fb64141b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:35.402926 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ab23ab69-6d41-4015-bdb4-db2fb64141b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.159465 Jun 03 13:23:35.403489 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 116/280] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:35 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:36.420363 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e87cb696-6c6c-4fc9-90b3-e7f6b992e457 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:36.420972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e87cb696-6c6c-4fc9-90b3-e7f6b992e457 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:36.427913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e87cb696-6c6c-4fc9-90b3-e7f6b992e457 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:36.428413 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e87cb696-6c6c-4fc9-90b3-e7f6b992e457 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:36.429174 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e87cb696-6c6c-4fc9-90b3-e7f6b992e457 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:36.429614 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e87cb696-6c6c-4fc9-90b3-e7f6b992e457 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:36.554045 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e87cb696-6c6c-4fc9-90b3-e7f6b992e457 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:36.561342 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e87cb696-6c6c-4fc9-90b3-e7f6b992e457 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.144877 Jun 03 13:23:36.561895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 165/281] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:36 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:37.577863 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1a570665-50ce-41fc-b1ae-96ada13ee644 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:37.578446 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-1a570665-50ce-41fc-b1ae-96ada13ee644 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:37.584967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1a570665-50ce-41fc-b1ae-96ada13ee644 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:37.585405 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1a570665-50ce-41fc-b1ae-96ada13ee644 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:37.586152 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1a570665-50ce-41fc-b1ae-96ada13ee644 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:37.586578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1a570665-50ce-41fc-b1ae-96ada13ee644 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:37.715423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-1a570665-50ce-41fc-b1ae-96ada13ee644 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:37.723207 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-1a570665-50ce-41fc-b1ae-96ada13ee644 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.149392 Jun 03 13:23:37.723774 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 117/282] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:37 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:38.740659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-fad0307a-ac39-4712-a66a-ce1d8ee700dd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:38.741271 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-fad0307a-ac39-4712-a66a-ce1d8ee700dd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:38.747558 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fad0307a-ac39-4712-a66a-ce1d8ee700dd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:38.748029 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fad0307a-ac39-4712-a66a-ce1d8ee700dd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:38.748859 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fad0307a-ac39-4712-a66a-ce1d8ee700dd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:38.749295 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fad0307a-ac39-4712-a66a-ce1d8ee700dd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:38.881585 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fad0307a-ac39-4712-a66a-ce1d8ee700dd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:38.889172 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-fad0307a-ac39-4712-a66a-ce1d8ee700dd tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.152319 Jun 03 13:23:38.889738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 166/283] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:38 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:39.380635 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-46a083bc-facd-4c89-a5fa-3bf3ecfe598b tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:39.381145 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-46a083bc-facd-4c89-a5fa-3bf3ecfe598b tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:39.387598 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46a083bc-facd-4c89-a5fa-3bf3ecfe598b tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:39.388033 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46a083bc-facd-4c89-a5fa-3bf3ecfe598b tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:39.388974 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46a083bc-facd-4c89-a5fa-3bf3ecfe598b tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:39.389409 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46a083bc-facd-4c89-a5fa-3bf3ecfe598b tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:39.403137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-46a083bc-facd-4c89-a5fa-3bf3ecfe598b tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] HTTP exception thrown: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-46a083bc-facd-4c89-a5fa-3bf3ecfe598b tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Request method failure captured: Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: DELETE /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 HTTP/1.1 Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgroitXW9BnhZATLWtlz72f62zhyYqq2aeSdR11RoEcEWcRZ2KSmLZHKnNT3SL6EEOVWqjpwMXsF7He-_SFlbHDa0Hp4RaF_E89or2YZSFFRIQvRmN9RttxzGzgMtpTCntsYB3GvjA3TBy9jaUMvWcnx6k5uUoCEF0pCNX-D5nkolnI Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: f6909571f8274f4ebf822ce71cd43c2b Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-DeleteServersTestJSON-1590599138 Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:23:39.404754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:23:39.406106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6909571f8274f4ebf822ce71cd43c2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6909571f8274f4ebf822ce71cd43c2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6909571f8274f4ebf822ce71cd43c2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6909571f8274f4ebf822ce71cd43c2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:23:39.406106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-DeleteServersTestJSON-1590599138 Jun 03 13:23:39.406106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: f6909571f8274f4ebf822ce71cd43c2b Jun 03 13:23:39.406106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-DeleteServersTestJSON-1590599138 Jun 03 13:23:39.406106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-DeleteServersTestJSON-1590599138-project Jun 03 13:23:39.406106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:23:39.406106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:23:39.406106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 144789e582de45c280d03b92dee5692a Jun 03 13:23:39.406106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-DeleteServersTestJSON-1590599138-project Jun 03 13:23:39.406106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:23:39.406106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:39.406106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '6ec28c8c-6e08-42ec-ac43-6f502db967c0'} Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:39.406873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:39.408291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:23:39.410156 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-46a083bc-facd-4c89-a5fa-3bf3ecfe598b tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Returning 404 to user: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:39.410156 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-46a083bc-facd-4c89-a5fa-3bf3ecfe598b tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 404 len: 111 microversion: 2.1 time: 0.029984 Jun 03 13:23:39.410156 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 118/284] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:23:39 2022] DELETE /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:23:39.414663 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8cfb0b8e-587f-40c0-a238-d9f4fff613f9 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:39.415276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8cfb0b8e-587f-40c0-a238-d9f4fff613f9 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] [instance: 6ec28c8c-6e08-42ec-ac43-6f502db967c0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:39.421276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8cfb0b8e-587f-40c0-a238-d9f4fff613f9 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:39.421731 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8cfb0b8e-587f-40c0-a238-d9f4fff613f9 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:39.422492 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8cfb0b8e-587f-40c0-a238-d9f4fff613f9 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:39.422931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8cfb0b8e-587f-40c0-a238-d9f4fff613f9 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:39.436235 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-8cfb0b8e-587f-40c0-a238-d9f4fff613f9 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] HTTP exception thrown: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8cfb0b8e-587f-40c0-a238-d9f4fff613f9 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Request method failure captured: Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 HTTP/1.1 Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgroitXW9BnhZATLWtlz72f62zhyYqq2aeSdR11RoEcEWcRZ2KSmLZHKnNT3SL6EEOVWqjpwMXsF7He-_SFlbHDa0Hp4RaF_E89or2YZSFFRIQvRmN9RttxzGzgMtpTCntsYB3GvjA3TBy9jaUMvWcnx6k5uUoCEF0pCNX-D5nkolnI Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: f6909571f8274f4ebf822ce71cd43c2b Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-DeleteServersTestJSON-1590599138 Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:23:39.438336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:23:39.440256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6909571f8274f4ebf822ce71cd43c2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6909571f8274f4ebf822ce71cd43c2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6909571f8274f4ebf822ce71cd43c2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6909571f8274f4ebf822ce71cd43c2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:23:39.440256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-DeleteServersTestJSON-1590599138 Jun 03 13:23:39.440256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: f6909571f8274f4ebf822ce71cd43c2b Jun 03 13:23:39.440256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-DeleteServersTestJSON-1590599138 Jun 03 13:23:39.440256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-DeleteServersTestJSON-1590599138-project Jun 03 13:23:39.440256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:23:39.440256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:23:39.440256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 144789e582de45c280d03b92dee5692a Jun 03 13:23:39.440256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-DeleteServersTestJSON-1590599138-project Jun 03 13:23:39.440256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:23:39.440256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:39.440256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '6ec28c8c-6e08-42ec-ac43-6f502db967c0'} Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:39.441047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. Jun 03 13:23:39.442371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:39.443574 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8cfb0b8e-587f-40c0-a238-d9f4fff613f9 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] Returning 404 to user: Instance 6ec28c8c-6e08-42ec-ac43-6f502db967c0 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:39.443574 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8cfb0b8e-587f-40c0-a238-d9f4fff613f9 tempest-DeleteServersTestJSON-1590599138 tempest-DeleteServersTestJSON-1590599138-project] 10.222.0.61 "GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0" status: 404 len: 111 microversion: 2.1 time: 0.029582 Jun 03 13:23:39.443574 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 167/285] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:39 2022] GET /compute/v2.1/servers/6ec28c8c-6e08-42ec-ac43-6f502db967c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:23:39.906281 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a58dce7b-2b3a-4ecd-941a-a92a2de215f2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:39.906895 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a58dce7b-2b3a-4ecd-941a-a92a2de215f2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:39.912890 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a58dce7b-2b3a-4ecd-941a-a92a2de215f2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:39.913371 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a58dce7b-2b3a-4ecd-941a-a92a2de215f2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:39.914083 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a58dce7b-2b3a-4ecd-941a-a92a2de215f2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:39.914518 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a58dce7b-2b3a-4ecd-941a-a92a2de215f2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:40.094277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a58dce7b-2b3a-4ecd-941a-a92a2de215f2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:40.101746 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a58dce7b-2b3a-4ecd-941a-a92a2de215f2 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.199411 Jun 03 13:23:40.102309 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 119/286] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:39 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:41.119258 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6a7a504c-555e-499c-9ad7-25ae8c61e70e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:41.119991 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6a7a504c-555e-499c-9ad7-25ae8c61e70e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:41.126142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6a7a504c-555e-499c-9ad7-25ae8c61e70e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:41.126662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6a7a504c-555e-499c-9ad7-25ae8c61e70e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:41.127438 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6a7a504c-555e-499c-9ad7-25ae8c61e70e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:41.127876 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6a7a504c-555e-499c-9ad7-25ae8c61e70e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:41.255605 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6a7a504c-555e-499c-9ad7-25ae8c61e70e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:41.263987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6a7a504c-555e-499c-9ad7-25ae8c61e70e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.148982 Jun 03 13:23:41.264575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 168/287] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:41 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:41.902759 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c0fb0c54-c874-4054-9a6d-26156f938e9a tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] Action: 'create', calling method: .version_select at 0x7f5bc8388430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-900119225", "metadata": {"Type": "work"}}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:23:42.281392 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0a3fb1f2-7280-4872-9733-bdca33d1aade tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:42.281998 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0a3fb1f2-7280-4872-9733-bdca33d1aade tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:42.288656 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0a3fb1f2-7280-4872-9733-bdca33d1aade tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:42.289108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0a3fb1f2-7280-4872-9733-bdca33d1aade tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:42.289859 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0a3fb1f2-7280-4872-9733-bdca33d1aade tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:42.290295 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0a3fb1f2-7280-4872-9733-bdca33d1aade tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:42.423118 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0a3fb1f2-7280-4872-9733-bdca33d1aade tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:42.431126 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0a3fb1f2-7280-4872-9733-bdca33d1aade tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.153879 Jun 03 13:23:42.431688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 169/288] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:42 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:23:42.512583 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c0fb0c54-c874-4054-9a6d-26156f938e9a tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.722202 Jun 03 13:23:42.513239 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 120/289] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Jun 3 13:23:41 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 724 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 13:23:42.525089 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7bea20fa-8bb0-4e26-819b-9627a5db39e2 tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] Calling method '.version_select at 0x7f5bc8c45ca0>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:42.573694 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7bea20fa-8bb0-4e26-819b-9627a5db39e2 tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0" status: 200 len: 352 microversion: 2.1 time: 0.052353 Jun 03 13:23:42.574404 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 170/290] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:23:42 2022] GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:43.449440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-46330f12-6a28-4d4d-a4d6-55fd0068afb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:43.450050 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-46330f12-6a28-4d4d-a4d6-55fd0068afb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:43.456860 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46330f12-6a28-4d4d-a4d6-55fd0068afb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:43.457339 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46330f12-6a28-4d4d-a4d6-55fd0068afb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:43.458098 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46330f12-6a28-4d4d-a4d6-55fd0068afb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:43.458536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46330f12-6a28-4d4d-a4d6-55fd0068afb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:43.586384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0e49b556-c109-4d62-99a7-09787deb3b7f tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] Calling method '.version_select at 0x7f5bc8bd0e50>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:43.591053 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-46330f12-6a28-4d4d-a4d6-55fd0068afb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:43.598826 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-46330f12-6a28-4d4d-a4d6-55fd0068afb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.153513 Jun 03 13:23:43.599261 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 121/291] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:43 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:43.633619 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0e49b556-c109-4d62-99a7-09787deb3b7f tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0" status: 200 len: 352 microversion: 2.1 time: 0.051121 Jun 03 13:23:43.634186 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 171/292] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:23:43 2022] GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:23:44.615650 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-36cb8ee4-1603-4809-a947-79d67e674ada tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:44.616373 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-36cb8ee4-1603-4809-a947-79d67e674ada tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:44.623355 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-36cb8ee4-1603-4809-a947-79d67e674ada tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:44.623816 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-36cb8ee4-1603-4809-a947-79d67e674ada tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:44.624614 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-36cb8ee4-1603-4809-a947-79d67e674ada tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:44.625054 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-36cb8ee4-1603-4809-a947-79d67e674ada tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:44.645816 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6881d333-a00c-4ca3-a762-dcba89d1e49d tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] Calling method '.version_select at 0x7f5bc8bd09d0>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:44.700036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6881d333-a00c-4ca3-a762-dcba89d1e49d tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0" status: 200 len: 352 microversion: 2.1 time: 0.058287 Jun 03 13:23:44.701141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 172/293] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:23:44 2022] GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:23:44.762675 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-36cb8ee4-1603-4809-a947-79d67e674ada tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:44.766907 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:44.774650 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-36cb8ee4-1603-4809-a947-79d67e674ada tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.162117 Jun 03 13:23:44.782410 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 122/294] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:44 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:45.712581 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4ce03745-550b-49d5-8bc5-b66465bd26f6 tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] Calling method '.version_select at 0x7f5bc8bd0a60>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:45.760782 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4ce03745-550b-49d5-8bc5-b66465bd26f6 tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0" status: 200 len: 353 microversion: 2.1 time: 0.051913 Jun 03 13:23:45.761371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 173/295] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:23:45 2022] GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:45.773838 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-be9e1f2f-3459-4f61-9cd8-c4193c6f5055 tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] Calling method '.version_select at 0x7f5bc83a1a60>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:45.790712 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8de563f2-4567-406b-8bb3-0ce5a4415ae7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:45.791314 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8de563f2-4567-406b-8bb3-0ce5a4415ae7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:45.797812 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8de563f2-4567-406b-8bb3-0ce5a4415ae7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:45.798262 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8de563f2-4567-406b-8bb3-0ce5a4415ae7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:45.799020 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8de563f2-4567-406b-8bb3-0ce5a4415ae7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:45.799459 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8de563f2-4567-406b-8bb3-0ce5a4415ae7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:45.823646 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-be9e1f2f-3459-4f61-9cd8-c4193c6f5055 tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0" status: 200 len: 353 microversion: 2.1 time: 0.054488 Jun 03 13:23:45.825002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 123/296] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:23:45 2022] GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:45.840693 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-938e05d5-d1b3-44c9-83e3-932e5f91b006 tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] Calling method '.version_select at 0x7f5bc83fa430>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:45.942299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8de563f2-4567-406b-8bb3-0ce5a4415ae7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:45.949858 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8de563f2-4567-406b-8bb3-0ce5a4415ae7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.163082 Jun 03 13:23:45.956355 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 174/297] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:45 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:46.076438 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-938e05d5-d1b3-44c9-83e3-932e5f91b006 tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0" status: 202 len: 0 microversion: 2.1 time: 0.239443 Jun 03 13:23:46.077015 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 124/298] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 13:23:45 2022] DELETE /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 13:23:46.086168 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f771ae45-a9d1-483e-8782-eef222feefdc tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] Calling method '.version_select at 0x7f5bc8c45940>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:46.190370 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f771ae45-a9d1-483e-8782-eef222feefdc tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0" status: 200 len: 352 microversion: 2.1 time: 0.107810 Jun 03 13:23:46.191188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 175/299] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:23:46 2022] GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:46.967630 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-bcdd5244-60d1-4bb0-ae23-1144113a575f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:46.968353 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-bcdd5244-60d1-4bb0-ae23-1144113a575f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:46.970712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:46.975986 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bcdd5244-60d1-4bb0-ae23-1144113a575f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:46.976453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bcdd5244-60d1-4bb0-ae23-1144113a575f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:46.977209 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bcdd5244-60d1-4bb0-ae23-1144113a575f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:46.977640 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bcdd5244-60d1-4bb0-ae23-1144113a575f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:47.103925 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-bcdd5244-60d1-4bb0-ae23-1144113a575f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:47.111551 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-bcdd5244-60d1-4bb0-ae23-1144113a575f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1522 microversion: 2.1 time: 0.148624 Jun 03 13:23:47.112110 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 125/300] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:46 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:47.202927 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8b284ee3-9299-4f45-a589-240e8b8f786e tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] Calling method '.version_select at 0x7f5bc8bd0b80>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:47.233496 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-8b284ee3-9299-4f45-a589-240e8b8f786e tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] HTTP exception thrown: Volume 0bbb7881-a520-4daf-9a91-3d52926ad0b0 could not be found. Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8b284ee3-9299-4f45-a589-240e8b8f786e tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] Request method failure captured: Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0 HTTP/1.1 Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgtddSbeLaRHWKm5kml7KXgLsJdP3JCAjF9LmQCOf6EhkDosOyL1ZCK3A7eIWXB1h3waiwIb7WsDxkFfosF-YrDq3lgUNYK3L6IwduyArd6fQBbcfQwx8zLxIQ-chfZCxWevU8tn3Dt68qHWgHj-1aIIqBXpT4MQsdN-4q7gSR1vuIk Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: cb5b48038fd3479aa381909449bf52eb Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesGetTestJSON-107093352 Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:23:47.235890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cb5b48038fd3479aa381909449bf52eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cb5b48038fd3479aa381909449bf52eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cb5b48038fd3479aa381909449bf52eb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cb5b48038fd3479aa381909449bf52eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesGetTestJSON-107093352 Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: cb5b48038fd3479aa381909449bf52eb Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesGetTestJSON-107093352 Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesGetTestJSON-107093352-project Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 245121e1c7df42fba17d9025601233bd Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesGetTestJSON-107093352-project Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Volume 0bbb7881-a520-4daf-9a91-3d52926ad0b0 could not be found. Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '0bbb7881-a520-4daf-9a91-3d52926ad0b0'} Jun 03 13:23:47.237640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0bbb7881-a520-4daf-9a91-3d52926ad0b0 could not be found. (HTTP 404) (Request-ID: req-54f51a61-6d91-42df-a15b-8ef78cf40e6e) Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:47.238484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:23:47.239570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0bbb7881-a520-4daf-9a91-3d52926ad0b0 could not be found. Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 13:23:47.241455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0bbb7881-a520-4daf-9a91-3d52926ad0b0 could not be found. Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0bbb7881-a520-4daf-9a91-3d52926ad0b0 could not be found. Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8b284ee3-9299-4f45-a589-240e8b8f786e tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] Returning 404 to user: Volume 0bbb7881-a520-4daf-9a91-3d52926ad0b0 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8b284ee3-9299-4f45-a589-240e8b8f786e tempest-VolumesGetTestJSON-107093352 tempest-VolumesGetTestJSON-107093352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0" status: 404 len: 109 microversion: 2.1 time: 0.038741 Jun 03 13:23:47.243061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 176/301] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 13:23:47 2022] GET /compute/v2.1/os-volumes/0bbb7881-a520-4daf-9a91-3d52926ad0b0 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:23:48.129873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-358bbfa7-43bd-4f20-b441-9d8af9447756 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:48.130598 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-358bbfa7-43bd-4f20-b441-9d8af9447756 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:48.137705 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-358bbfa7-43bd-4f20-b441-9d8af9447756 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:48.138149 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-358bbfa7-43bd-4f20-b441-9d8af9447756 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:48.143457 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-358bbfa7-43bd-4f20-b441-9d8af9447756 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:48.143457 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-358bbfa7-43bd-4f20-b441-9d8af9447756 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:48.286003 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-358bbfa7-43bd-4f20-b441-9d8af9447756 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:48.294324 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-358bbfa7-43bd-4f20-b441-9d8af9447756 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1502 microversion: 2.1 time: 0.168947 Jun 03 13:23:48.295869 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 126/302] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:48 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:48.317279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-bcdf8629-b8c8-4b94-8e13-31d8448995f6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:48.317957 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-bcdf8629-b8c8-4b94-8e13-31d8448995f6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:48.320319 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=38 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:48.325152 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bcdf8629-b8c8-4b94-8e13-31d8448995f6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:48.325608 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bcdf8629-b8c8-4b94-8e13-31d8448995f6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:48.326469 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bcdf8629-b8c8-4b94-8e13-31d8448995f6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:48.326799 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bcdf8629-b8c8-4b94-8e13-31d8448995f6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:48.469226 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-bcdf8629-b8c8-4b94-8e13-31d8448995f6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:48.474080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:48.478638 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-bcdf8629-b8c8-4b94-8e13-31d8448995f6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1516 microversion: 2.1 time: 0.166670 Jun 03 13:23:48.479191 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 177/303] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:48 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:51.431745 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dbdeb77c-d3ae-4a08-8ffc-83b8729e55df tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:23:51.432844 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dbdeb77c-d3ae-4a08-8ffc-83b8729e55df tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:51.441872 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dbdeb77c-d3ae-4a08-8ffc-83b8729e55df tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:51.442391 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dbdeb77c-d3ae-4a08-8ffc-83b8729e55df tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:51.444367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dbdeb77c-d3ae-4a08-8ffc-83b8729e55df tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:51.444834 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dbdeb77c-d3ae-4a08-8ffc-83b8729e55df tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:51.483897 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-dbdeb77c-d3ae-4a08-8ffc-83b8729e55df tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lazy-loading 'flavor' on Instance uuid 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:23:51.955968 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dbdeb77c-d3ae-4a08-8ffc-83b8729e55df tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "POST /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08/action" status: 200 len: 32 microversion: 2.1 time: 0.529990 Jun 03 13:23:51.957249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 127/304] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:23:51 2022] POST /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08/action => generated 32 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:23:51.967108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d99cd321-2f23-4b3a-bc24-d0405c668ac9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:51.967886 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d99cd321-2f23-4b3a-bc24-d0405c668ac9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:51.974857 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d99cd321-2f23-4b3a-bc24-d0405c668ac9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:51.975309 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d99cd321-2f23-4b3a-bc24-d0405c668ac9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:51.976083 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d99cd321-2f23-4b3a-bc24-d0405c668ac9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:51.976546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d99cd321-2f23-4b3a-bc24-d0405c668ac9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:52.204796 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d99cd321-2f23-4b3a-bc24-d0405c668ac9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:52.213339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d99cd321-2f23-4b3a-bc24-d0405c668ac9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.250331 Jun 03 13:23:52.214379 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 178/305] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:51 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:53.231973 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ca744b41-5e3c-4815-b597-318c5ef3e989 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:53.232693 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ca744b41-5e3c-4815-b597-318c5ef3e989 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:53.240469 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ca744b41-5e3c-4815-b597-318c5ef3e989 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:53.240925 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ca744b41-5e3c-4815-b597-318c5ef3e989 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:53.241699 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ca744b41-5e3c-4815-b597-318c5ef3e989 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:53.242145 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ca744b41-5e3c-4815-b597-318c5ef3e989 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:53.392412 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ca744b41-5e3c-4815-b597-318c5ef3e989 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:53.401528 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ca744b41-5e3c-4815-b597-318c5ef3e989 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.174105 Jun 03 13:23:53.402115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 128/306] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:53 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:54.419863 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3dc1c3cc-ad4c-4e8f-866b-e74589717374 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:54.420509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3dc1c3cc-ad4c-4e8f-866b-e74589717374 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:54.427227 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3dc1c3cc-ad4c-4e8f-866b-e74589717374 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:54.427701 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3dc1c3cc-ad4c-4e8f-866b-e74589717374 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:54.428514 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3dc1c3cc-ad4c-4e8f-866b-e74589717374 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:54.428960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3dc1c3cc-ad4c-4e8f-866b-e74589717374 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:54.564726 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3dc1c3cc-ad4c-4e8f-866b-e74589717374 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:54.571669 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3dc1c3cc-ad4c-4e8f-866b-e74589717374 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.155769 Jun 03 13:23:54.572320 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 179/307] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:54 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:55.589224 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-84535b4e-2e93-4acf-9e22-11afae383cd9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:55.589829 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-84535b4e-2e93-4acf-9e22-11afae383cd9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:55.596396 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-84535b4e-2e93-4acf-9e22-11afae383cd9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:55.596836 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-84535b4e-2e93-4acf-9e22-11afae383cd9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:55.598198 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-84535b4e-2e93-4acf-9e22-11afae383cd9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:55.598634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-84535b4e-2e93-4acf-9e22-11afae383cd9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:55.732796 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-84535b4e-2e93-4acf-9e22-11afae383cd9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:55.740735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-84535b4e-2e93-4acf-9e22-11afae383cd9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.155164 Jun 03 13:23:55.741307 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 129/308] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:55 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:56.758450 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-cb32f13a-a9b2-4e52-a98f-b0445e16a3fb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:56.759084 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-cb32f13a-a9b2-4e52-a98f-b0445e16a3fb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:56.765163 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cb32f13a-a9b2-4e52-a98f-b0445e16a3fb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:56.765604 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cb32f13a-a9b2-4e52-a98f-b0445e16a3fb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:56.766354 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cb32f13a-a9b2-4e52-a98f-b0445e16a3fb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:56.766782 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cb32f13a-a9b2-4e52-a98f-b0445e16a3fb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:56.894815 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cb32f13a-a9b2-4e52-a98f-b0445e16a3fb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:56.904845 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-cb32f13a-a9b2-4e52-a98f-b0445e16a3fb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.150576 Jun 03 13:23:56.905409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 180/309] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:56 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:57.921866 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a78452ac-d6be-4089-8d59-30e4e7d473d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:57.922505 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a78452ac-d6be-4089-8d59-30e4e7d473d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:57.929378 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a78452ac-d6be-4089-8d59-30e4e7d473d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:57.929818 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a78452ac-d6be-4089-8d59-30e4e7d473d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:57.930566 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a78452ac-d6be-4089-8d59-30e4e7d473d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:57.930989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a78452ac-d6be-4089-8d59-30e4e7d473d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:58.061098 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a78452ac-d6be-4089-8d59-30e4e7d473d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:58.068952 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a78452ac-d6be-4089-8d59-30e4e7d473d6 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.150830 Jun 03 13:23:58.069512 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 130/310] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:57 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:59.086632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c3f9a102-a4c4-454a-a2b3-145fda0e6418 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:59.087210 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c3f9a102-a4c4-454a-a2b3-145fda0e6418 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:59.093309 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c3f9a102-a4c4-454a-a2b3-145fda0e6418 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:59.093756 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c3f9a102-a4c4-454a-a2b3-145fda0e6418 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:59.094542 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c3f9a102-a4c4-454a-a2b3-145fda0e6418 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:59.094978 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c3f9a102-a4c4-454a-a2b3-145fda0e6418 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:59.225120 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c3f9a102-a4c4-454a-a2b3-145fda0e6418 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:59.232695 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c3f9a102-a4c4-454a-a2b3-145fda0e6418 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.150678 Jun 03 13:23:59.233258 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 181/311] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:59 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:00.250508 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a4a11c46-7eb6-48e5-a84f-787eee83d95d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:00.251097 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a4a11c46-7eb6-48e5-a84f-787eee83d95d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:00.259085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a4a11c46-7eb6-48e5-a84f-787eee83d95d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:00.259085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a4a11c46-7eb6-48e5-a84f-787eee83d95d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:00.259689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a4a11c46-7eb6-48e5-a84f-787eee83d95d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:00.260128 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a4a11c46-7eb6-48e5-a84f-787eee83d95d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:00.432866 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a4a11c46-7eb6-48e5-a84f-787eee83d95d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:00.440489 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a4a11c46-7eb6-48e5-a84f-787eee83d95d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.193711 Jun 03 13:24:00.441070 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 131/312] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:00 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:01.458676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-48c412f8-394c-45e2-b6cb-e7cbb8914407 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:01.459288 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-48c412f8-394c-45e2-b6cb-e7cbb8914407 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:01.465362 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-48c412f8-394c-45e2-b6cb-e7cbb8914407 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:01.465810 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-48c412f8-394c-45e2-b6cb-e7cbb8914407 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:01.467613 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-48c412f8-394c-45e2-b6cb-e7cbb8914407 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:01.468057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-48c412f8-394c-45e2-b6cb-e7cbb8914407 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:01.613490 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-48c412f8-394c-45e2-b6cb-e7cbb8914407 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:01.622039 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-48c412f8-394c-45e2-b6cb-e7cbb8914407 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.168068 Jun 03 13:24:01.625477 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 182/313] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:01 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:02.639678 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3d552662-8dda-4858-9ca9-9b982da2949a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:02.640445 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3d552662-8dda-4858-9ca9-9b982da2949a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:02.647011 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3d552662-8dda-4858-9ca9-9b982da2949a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:02.647458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3d552662-8dda-4858-9ca9-9b982da2949a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:02.648432 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3d552662-8dda-4858-9ca9-9b982da2949a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:02.649024 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3d552662-8dda-4858-9ca9-9b982da2949a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:02.838601 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3d552662-8dda-4858-9ca9-9b982da2949a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:02.846994 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3d552662-8dda-4858-9ca9-9b982da2949a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.210975 Jun 03 13:24:02.857098 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 132/314] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:02 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:03.863886 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ffa980dd-0b1d-4548-b1fd-0f271885ca0f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:03.864731 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ffa980dd-0b1d-4548-b1fd-0f271885ca0f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:03.870965 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ffa980dd-0b1d-4548-b1fd-0f271885ca0f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:03.871405 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ffa980dd-0b1d-4548-b1fd-0f271885ca0f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:03.872219 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ffa980dd-0b1d-4548-b1fd-0f271885ca0f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:03.872661 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ffa980dd-0b1d-4548-b1fd-0f271885ca0f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:04.008176 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ffa980dd-0b1d-4548-b1fd-0f271885ca0f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:04.015737 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ffa980dd-0b1d-4548-b1fd-0f271885ca0f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.155820 Jun 03 13:24:04.016337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 183/315] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:03 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:05.033747 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-cd70e917-43d2-43c0-96c8-95c635c806ca tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:05.034353 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-cd70e917-43d2-43c0-96c8-95c635c806ca tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:05.042011 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cd70e917-43d2-43c0-96c8-95c635c806ca tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:05.042453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cd70e917-43d2-43c0-96c8-95c635c806ca tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:05.043352 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cd70e917-43d2-43c0-96c8-95c635c806ca tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:05.044005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cd70e917-43d2-43c0-96c8-95c635c806ca tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:05.194842 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-cd70e917-43d2-43c0-96c8-95c635c806ca tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:05.202599 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-cd70e917-43d2-43c0-96c8-95c635c806ca tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.172785 Jun 03 13:24:05.203173 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 133/316] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:05 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:06.220857 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-52a75a5e-fe53-479a-965c-b24d668e960b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:06.222779 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-52a75a5e-fe53-479a-965c-b24d668e960b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:06.229839 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-52a75a5e-fe53-479a-965c-b24d668e960b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:06.230288 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-52a75a5e-fe53-479a-965c-b24d668e960b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:06.231062 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-52a75a5e-fe53-479a-965c-b24d668e960b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:06.231497 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-52a75a5e-fe53-479a-965c-b24d668e960b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:06.388375 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-52a75a5e-fe53-479a-965c-b24d668e960b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:06.399719 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-52a75a5e-fe53-479a-965c-b24d668e960b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.183059 Jun 03 13:24:06.400420 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 184/317] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:06 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:07.420293 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-133ea30b-09cd-4fa0-ac78-a97ca5aef20d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:07.420904 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-133ea30b-09cd-4fa0-ac78-a97ca5aef20d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:07.427674 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-133ea30b-09cd-4fa0-ac78-a97ca5aef20d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:07.428376 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-133ea30b-09cd-4fa0-ac78-a97ca5aef20d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:07.429399 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-133ea30b-09cd-4fa0-ac78-a97ca5aef20d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:07.429992 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-133ea30b-09cd-4fa0-ac78-a97ca5aef20d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:07.638557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-133ea30b-09cd-4fa0-ac78-a97ca5aef20d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:07.647834 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-133ea30b-09cd-4fa0-ac78-a97ca5aef20d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1502 microversion: 2.1 time: 0.231501 Jun 03 13:24:07.648455 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 134/318] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:07 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:07.665628 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7d2864e6-473b-44c0-835d-84fdd57dbfe7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c848c46-9214-492f-9f50-85f428d860b5"}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:07.666882 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7d2864e6-473b-44c0-835d-84fdd57dbfe7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:07.672911 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7d2864e6-473b-44c0-835d-84fdd57dbfe7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:07.673370 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7d2864e6-473b-44c0-835d-84fdd57dbfe7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:07.674133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7d2864e6-473b-44c0-835d-84fdd57dbfe7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:07.674766 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7d2864e6-473b-44c0-835d-84fdd57dbfe7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:07.698611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-7d2864e6-473b-44c0-835d-84fdd57dbfe7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] HTTP exception thrown: Cannot 'attach_volume' instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 while it is in vm_state rescued Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7d2864e6-473b-44c0-835d-84fdd57dbfe7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Request method failure captured: Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: POST /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08/os-volume_attachments HTTP/1.1 Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 74 Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr4hGDdogvcvqQUufQA49jnojsGlzdh6EROqvsENnZprcFlWM-FNGtFOQwPmvK6LhvJ8YyKCMkl8c6MysPOijBxI0Vi2CRs4KJvXzkVBev4KlhDZasL8Z9jVthzq5mfPBxmxK2Unmt23N3AFr0hGobck6dKQgRDP9GpkBAWrirmO7k Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 422fdba5c8474b93b285700c07e9304c Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:24:07.700299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:24:07.701705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_422fdba5c8474b93b285700c07e9304c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:24:07.701705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:24:07.701705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 422fdba5c8474b93b285700c07e9304c Jun 03 13:24:07.701705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:24:07.701705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-ServerRescueNegativeTestJSON-1706662507-project Jun 03 13:24:07.701705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:24:07.701705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:24:07.701705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 308bdbe63af5415d8e817bd9ba2fad3e Jun 03 13:24:07.701705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1706662507-project Jun 03 13:24:07.701705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Jun 03 13:24:07.701705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {"volumeAttachment": {"volumeId": "4c848c46-9214-492f-9f50-85f428d860b5"}} Jun 03 13:24:07.701705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Cannot 'attach_volume' instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 while it is in vm_state rescued Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'server_id': '13c52831-b2e0-4fb4-8aa7-6e99a89a3f08', 'body': {'volumeAttachment': {'volumeId': '4c848c46-9214-492f-9f50-85f428d860b5'}}} Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:24:07.702586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 while it is in vm_state rescued Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:24:07.703960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:24:07.705035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:24:07.705035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:24:07.705035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 while it is in vm_state rescued Jun 03 13:24:07.705035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:24:07.705035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7d2864e6-473b-44c0-835d-84fdd57dbfe7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Returning 409 to user: Cannot 'attach_volume' instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 while it is in vm_state rescued {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:24:07.705035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7d2864e6-473b-44c0-835d-84fdd57dbfe7 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "POST /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041195 Jun 03 13:24:07.705035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 185/319] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:24:07 2022] POST /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 13:24:07.711716 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dd18dad3-eacc-43b7-92de-3828d721c530 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:07.712314 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dd18dad3-eacc-43b7-92de-3828d721c530 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:07.719088 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dd18dad3-eacc-43b7-92de-3828d721c530 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:07.719546 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dd18dad3-eacc-43b7-92de-3828d721c530 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:07.720352 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dd18dad3-eacc-43b7-92de-3828d721c530 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:07.720789 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dd18dad3-eacc-43b7-92de-3828d721c530 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:08.042445 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dd18dad3-eacc-43b7-92de-3828d721c530 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "POST /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08/action" status: 202 len: 0 microversion: 2.1 time: 0.334890 Jun 03 13:24:08.046966 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 135/320] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:24:07 2022] POST /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:24:08.051468 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-edea5c49-13ff-4999-b568-c511dc912056 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:08.052112 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-edea5c49-13ff-4999-b568-c511dc912056 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:08.058124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-edea5c49-13ff-4999-b568-c511dc912056 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:08.058575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-edea5c49-13ff-4999-b568-c511dc912056 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:08.059342 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-edea5c49-13ff-4999-b568-c511dc912056 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:08.059783 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-edea5c49-13ff-4999-b568-c511dc912056 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:08.510771 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-edea5c49-13ff-4999-b568-c511dc912056 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:08.520900 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-edea5c49-13ff-4999-b568-c511dc912056 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1510 microversion: 2.1 time: 0.472293 Jun 03 13:24:08.523685 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 186/321] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:08 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:09.540460 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1b481c27-35d2-401a-b7d7-628acee149ea tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:09.542014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-1b481c27-35d2-401a-b7d7-628acee149ea tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:09.551162 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1b481c27-35d2-401a-b7d7-628acee149ea tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:09.552104 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1b481c27-35d2-401a-b7d7-628acee149ea tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:09.554931 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1b481c27-35d2-401a-b7d7-628acee149ea tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:09.556256 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1b481c27-35d2-401a-b7d7-628acee149ea tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:09.791478 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-1b481c27-35d2-401a-b7d7-628acee149ea tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:09.810520 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-1b481c27-35d2-401a-b7d7-628acee149ea tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1510 microversion: 2.1 time: 0.274738 Jun 03 13:24:09.811361 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 136/322] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:09 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1510 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:10.840606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-60446a43-3a34-4d5e-a818-303f55bd6805 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:10.841778 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-60446a43-3a34-4d5e-a818-303f55bd6805 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:10.848949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-60446a43-3a34-4d5e-a818-303f55bd6805 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:10.849805 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-60446a43-3a34-4d5e-a818-303f55bd6805 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:10.850750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-60446a43-3a34-4d5e-a818-303f55bd6805 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:10.851339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-60446a43-3a34-4d5e-a818-303f55bd6805 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:10.997458 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-60446a43-3a34-4d5e-a818-303f55bd6805 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:11.013348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-60446a43-3a34-4d5e-a818-303f55bd6805 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1510 microversion: 2.1 time: 0.176796 Jun 03 13:24:11.023322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 187/323] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:10 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:12.029960 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0ef7ca10-43d8-4c67-9465-edd515af302c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:12.030786 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0ef7ca10-43d8-4c67-9465-edd515af302c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:12.044601 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0ef7ca10-43d8-4c67-9465-edd515af302c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:12.045247 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0ef7ca10-43d8-4c67-9465-edd515af302c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:12.046033 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0ef7ca10-43d8-4c67-9465-edd515af302c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:12.046565 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0ef7ca10-43d8-4c67-9465-edd515af302c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:12.312166 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0ef7ca10-43d8-4c67-9465-edd515af302c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:12.322690 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0ef7ca10-43d8-4c67-9465-edd515af302c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1510 microversion: 2.1 time: 0.296546 Jun 03 13:24:12.328300 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 137/324] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:12 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1510 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:24:13.341254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-675c2a05-70c8-46ef-9011-10d9e5d936aa tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:13.341895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-675c2a05-70c8-46ef-9011-10d9e5d936aa tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:13.348885 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-675c2a05-70c8-46ef-9011-10d9e5d936aa tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:13.353578 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-675c2a05-70c8-46ef-9011-10d9e5d936aa tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:13.353578 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-675c2a05-70c8-46ef-9011-10d9e5d936aa tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:13.353578 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-675c2a05-70c8-46ef-9011-10d9e5d936aa tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:13.518401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-675c2a05-70c8-46ef-9011-10d9e5d936aa tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:13.528022 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-675c2a05-70c8-46ef-9011-10d9e5d936aa tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1516 microversion: 2.1 time: 0.190647 Jun 03 13:24:13.528927 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 188/325] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:13 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:16.468194 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c7cd9a63-cf5b-40f4-a602-d75d06b4b3d5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Action: 'create', calling method: .version_select at 0x7f5bc83a1310>, body: {"keypair": {"name": "tempest-keypair-329127318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAROABT6YLyerVs2j/VANZOZaXaLrriMaxW/e53d04Kwdc/gJba2GiVrTG9S2TLN216wI28c1IN23y5rmHD9z1iOUjYTyGjHJTgpjeH9MbBY58GLOMNbckEbIzmfCiIxpg=="}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:16.486944 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-c7cd9a63-cf5b-40f4-a602-d75d06b4b3d5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Getting quotas for project 422fdba5c8474b93b285700c07e9304c. Resources: {'key_pairs'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:24:16.491452 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-c7cd9a63-cf5b-40f4-a602-d75d06b4b3d5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Getting quotas for user 308bdbe63af5415d8e817bd9ba2fad3e and project 422fdba5c8474b93b285700c07e9304c. Resources: {'key_pairs'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:24:16.600064 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c7cd9a63-cf5b-40f4-a602-d75d06b4b3d5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136674 Jun 03 13:24:16.601650 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 138/326] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 13:24:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:24:19.980306 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-978081642", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03b8c0d4-f175-4be9-832d-e4e605e93f1e"}], "security_groups": [{"name": "tempest-securitygroup--157997"}], "key_name": "tempest-keypair-329127318", "user_data": "}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:20.001748 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=24 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:20.134897 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] validate_networks() for [('03b8c0d4-f175-4be9-832d-e4e605e93f1e', None, None, None, None, None)] {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:24:20.657032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:24:20.657662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:24:20.658449 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:24:20.659159 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:24:20.659776 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:24:20.689071 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:20.690317 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:20.691580 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:20.692781 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:20.722654 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Getting quotas for project 422fdba5c8474b93b285700c07e9304c. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:24:20.729331 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Getting quotas for user 308bdbe63af5415d8e817bd9ba2fad3e and project 422fdba5c8474b93b285700c07e9304c. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:24:20.762319 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:24:20.767907 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:24:20.986762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4e6f23d6-b9b6-4dcb-99f3-0fd031945398 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.010762 Jun 03 13:24:20.990190 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 189/327] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:24:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:24:21.012246 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-46b3a07f-4b1a-406f-893d-fe9e3b4b6957 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:21.012787 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-46b3a07f-4b1a-406f-893d-fe9e3b4b6957 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:21.016420 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:21.099265 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-46b3a07f-4b1a-406f-893d-fe9e3b4b6957 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:21.109158 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-46b3a07f-4b1a-406f-893d-fe9e3b4b6957 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1244 microversion: 2.1 time: 0.110342 Jun 03 13:24:21.121819 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 139/328] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:20 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1244 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:22.129255 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b4453488-d976-4a39-83fe-334812189505 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:22.131064 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b4453488-d976-4a39-83fe-334812189505 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:22.137982 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4453488-d976-4a39-83fe-334812189505 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:22.138871 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4453488-d976-4a39-83fe-334812189505 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:22.139844 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4453488-d976-4a39-83fe-334812189505 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:22.140513 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4453488-d976-4a39-83fe-334812189505 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:22.143639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=68 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:22.230760 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b4453488-d976-4a39-83fe-334812189505 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:22.244279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b4453488-d976-4a39-83fe-334812189505 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1248 microversion: 2.1 time: 0.118422 Jun 03 13:24:22.245516 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 190/329] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:22 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1248 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:23.263315 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-cce90154-9cb4-40ed-a287-b7b19528171c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:23.266696 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-cce90154-9cb4-40ed-a287-b7b19528171c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:23.269340 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:23.282856 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cce90154-9cb4-40ed-a287-b7b19528171c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:23.287390 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cce90154-9cb4-40ed-a287-b7b19528171c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:23.288588 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cce90154-9cb4-40ed-a287-b7b19528171c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:23.291028 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cce90154-9cb4-40ed-a287-b7b19528171c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:23.417848 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-cce90154-9cb4-40ed-a287-b7b19528171c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:23.432532 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-cce90154-9cb4-40ed-a287-b7b19528171c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1296 microversion: 2.1 time: 0.173786 Jun 03 13:24:23.436559 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 140/330] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:23 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1296 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:24.478818 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7e8506ed-3bbf-4759-867d-8b741dbe7c5f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:24.483318 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7e8506ed-3bbf-4759-867d-8b741dbe7c5f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:24.512262 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7e8506ed-3bbf-4759-867d-8b741dbe7c5f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:24.512720 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7e8506ed-3bbf-4759-867d-8b741dbe7c5f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:24.521205 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7e8506ed-3bbf-4759-867d-8b741dbe7c5f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:24.521913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7e8506ed-3bbf-4759-867d-8b741dbe7c5f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:24.684566 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7e8506ed-3bbf-4759-867d-8b741dbe7c5f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:24.695091 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7e8506ed-3bbf-4759-867d-8b741dbe7c5f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1314 microversion: 2.1 time: 0.244519 Jun 03 13:24:24.700679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 191/331] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:24 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:25.724509 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8d5e3e3f-a107-45bb-8f8d-d8f65a73c97b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:25.726013 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8d5e3e3f-a107-45bb-8f8d-d8f65a73c97b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:25.753445 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8d5e3e3f-a107-45bb-8f8d-d8f65a73c97b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:25.757888 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8d5e3e3f-a107-45bb-8f8d-d8f65a73c97b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:25.758883 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8d5e3e3f-a107-45bb-8f8d-d8f65a73c97b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:25.759440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8d5e3e3f-a107-45bb-8f8d-d8f65a73c97b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:26.209486 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8d5e3e3f-a107-45bb-8f8d-d8f65a73c97b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:26.218315 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8d5e3e3f-a107-45bb-8f8d-d8f65a73c97b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1366 microversion: 2.1 time: 0.503440 Jun 03 13:24:26.236747 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 141/332] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:25 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1366 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:27.236689 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5288798b-1296-4242-a047-8a43387fdeec tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:27.243879 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5288798b-1296-4242-a047-8a43387fdeec tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:27.250602 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-616b2c0b-b135-406a-8e0b-e938da6af76b req-b8c56a07-e433-4f06-8f6c-3a4baf53232c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5852e29d-4480-4e14-9e17-d4cccdcb7d1a", "tag": "72222d2c-4db5-4768-b158-b370d5e0b875"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:27.264052 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5288798b-1296-4242-a047-8a43387fdeec tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:27.266133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5288798b-1296-4242-a047-8a43387fdeec tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:27.268699 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5288798b-1296-4242-a047-8a43387fdeec tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:27.268972 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-616b2c0b-b135-406a-8e0b-e938da6af76b req-b8c56a07-e433-4f06-8f6c-3a4baf53232c service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:27.269487 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5288798b-1296-4242-a047-8a43387fdeec tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:27.269736 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-616b2c0b-b135-406a-8e0b-e938da6af76b req-b8c56a07-e433-4f06-8f6c-3a4baf53232c service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:27.295055 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-616b2c0b-b135-406a-8e0b-e938da6af76b req-b8c56a07-e433-4f06-8f6c-3a4baf53232c service nova] Creating event network-changed:72222d2c-4db5-4768-b158-b370d5e0b875 for instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a on hv-cinder-80135 Jun 03 13:24:27.302976 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-616b2c0b-b135-406a-8e0b-e938da6af76b req-b8c56a07-e433-4f06-8f6c-3a4baf53232c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059115 Jun 03 13:24:27.305664 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 142/333] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 03 13:24:27.915789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5288798b-1296-4242-a047-8a43387fdeec tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:27.924130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5288798b-1296-4242-a047-8a43387fdeec tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1366 microversion: 2.1 time: 0.691215 Jun 03 13:24:27.937755 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 192/334] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:27 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1366 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:28.947301 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e76f270c-bab7-485c-b7d9-e14601b03964 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:28.948066 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e76f270c-bab7-485c-b7d9-e14601b03964 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:28.960031 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e76f270c-bab7-485c-b7d9-e14601b03964 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:28.960742 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e76f270c-bab7-485c-b7d9-e14601b03964 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:28.961525 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e76f270c-bab7-485c-b7d9-e14601b03964 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:28.961968 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e76f270c-bab7-485c-b7d9-e14601b03964 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:29.139074 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e76f270c-bab7-485c-b7d9-e14601b03964 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:29.148897 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e76f270c-bab7-485c-b7d9-e14601b03964 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1366 microversion: 2.1 time: 0.207392 Jun 03 13:24:29.149895 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 143/335] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:28 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:30.166192 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b93ca320-5609-4e7d-9ae3-f3fb41f565b0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:30.166864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b93ca320-5609-4e7d-9ae3-f3fb41f565b0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:30.173750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b93ca320-5609-4e7d-9ae3-f3fb41f565b0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:30.174196 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b93ca320-5609-4e7d-9ae3-f3fb41f565b0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:30.174955 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b93ca320-5609-4e7d-9ae3-f3fb41f565b0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:30.175386 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b93ca320-5609-4e7d-9ae3-f3fb41f565b0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:30.316586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b93ca320-5609-4e7d-9ae3-f3fb41f565b0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:30.327285 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b93ca320-5609-4e7d-9ae3-f3fb41f565b0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1366 microversion: 2.1 time: 0.164995 Jun 03 13:24:30.327823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 193/336] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:30 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:31.343830 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-38ba5df4-eda1-438f-ba71-887bfc1cfc5a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:31.346564 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-38ba5df4-eda1-438f-ba71-887bfc1cfc5a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:31.349407 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=6 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:31.354275 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-38ba5df4-eda1-438f-ba71-887bfc1cfc5a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:31.354996 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-38ba5df4-eda1-438f-ba71-887bfc1cfc5a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:31.355860 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-38ba5df4-eda1-438f-ba71-887bfc1cfc5a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:31.356507 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-38ba5df4-eda1-438f-ba71-887bfc1cfc5a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:31.507516 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-38ba5df4-eda1-438f-ba71-887bfc1cfc5a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:31.517793 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-38ba5df4-eda1-438f-ba71-887bfc1cfc5a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1366 microversion: 2.1 time: 0.177650 Jun 03 13:24:31.518819 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 144/337] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:31 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:32.535045 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c74dc337-4cda-4a52-ae59-2dfc5d7ca834 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:32.535834 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c74dc337-4cda-4a52-ae59-2dfc5d7ca834 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:32.541545 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:32.542202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=6 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:32.543716 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c74dc337-4cda-4a52-ae59-2dfc5d7ca834 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:32.544398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c74dc337-4cda-4a52-ae59-2dfc5d7ca834 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:32.545369 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c74dc337-4cda-4a52-ae59-2dfc5d7ca834 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:32.545810 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c74dc337-4cda-4a52-ae59-2dfc5d7ca834 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:32.701517 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c74dc337-4cda-4a52-ae59-2dfc5d7ca834 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:32.715409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c74dc337-4cda-4a52-ae59-2dfc5d7ca834 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1366 microversion: 2.1 time: 0.184225 Jun 03 13:24:32.716104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 194/338] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:32 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:33.732851 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3c5ff39a-3c0d-41fb-9d5c-a2ca943db7ab tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:33.733460 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3c5ff39a-3c0d-41fb-9d5c-a2ca943db7ab tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:33.739615 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3c5ff39a-3c0d-41fb-9d5c-a2ca943db7ab tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:33.740055 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3c5ff39a-3c0d-41fb-9d5c-a2ca943db7ab tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:33.740854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3c5ff39a-3c0d-41fb-9d5c-a2ca943db7ab tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:33.741285 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3c5ff39a-3c0d-41fb-9d5c-a2ca943db7ab tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:33.881608 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3c5ff39a-3c0d-41fb-9d5c-a2ca943db7ab tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:33.889115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3c5ff39a-3c0d-41fb-9d5c-a2ca943db7ab tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1366 microversion: 2.1 time: 0.160091 Jun 03 13:24:33.889715 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 145/339] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:33 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:34.906543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-28bed1e8-ddeb-436d-a509-2a7b840c4da5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:34.907152 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-28bed1e8-ddeb-436d-a509-2a7b840c4da5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:34.913845 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-28bed1e8-ddeb-436d-a509-2a7b840c4da5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:34.914294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-28bed1e8-ddeb-436d-a509-2a7b840c4da5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:34.915051 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-28bed1e8-ddeb-436d-a509-2a7b840c4da5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:34.915488 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-28bed1e8-ddeb-436d-a509-2a7b840c4da5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:35.044374 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-28bed1e8-ddeb-436d-a509-2a7b840c4da5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:35.046843 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f518d577-f172-49b6-aaf4-5e011908385d tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Action: 'create', calling method: .version_select at 0x7f5bc83811f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-225891743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIfj3liIMOWssXAsvaIt9bk7s5o8a9EsRVVH4FOCl2kREZ/iY0GFEdESWYBQcLc2m5AOUrU90wfcdfrG9fmjBG+M+mPi+RUtTffpVDYSOm19GB3OkwXJPuh4ZQg6UWrqQ=="}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:35.052843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-28bed1e8-ddeb-436d-a509-2a7b840c4da5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1366 microversion: 2.1 time: 0.150163 Jun 03 13:24:35.053412 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 195/340] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:34 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:35.059947 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-f518d577-f172-49b6-aaf4-5e011908385d tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Getting quotas for project 03432cb8c28c46fba16dc9f88d648d11. Resources: {'key_pairs'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:24:35.063687 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-f518d577-f172-49b6-aaf4-5e011908385d tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Getting quotas for user 4d0490962ec743048ef924340c93de20 and project 03432cb8c28c46fba16dc9f88d648d11. Resources: {'key_pairs'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:24:35.161076 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f518d577-f172-49b6-aaf4-5e011908385d tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.119160 Jun 03 13:24:35.161795 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 146/341] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 13:24:35 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:24:35.266794 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1802738729", "imageRef": "4ed2dc0d-135f-4b1f-a184-533b68ca6e4d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-225891743", "networks": [{"uuid": "1ad928b0-eb20-4194-ac0d-265b8e9256d5"}]}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:35.315894 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] validate_networks() for [('1ad928b0-eb20-4194-ac0d-265b8e9256d5', None, None, None, None, None)] {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:24:35.694838 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:24:35.695288 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:24:35.695759 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:24:35.696181 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:24:35.696594 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:24:35.706086 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:35.706536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:35.708045 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:35.708517 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:35.724760 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Getting quotas for project 03432cb8c28c46fba16dc9f88d648d11. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:24:35.728750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Getting quotas for user 4d0490962ec743048ef924340c93de20 and project 03432cb8c28c46fba16dc9f88d648d11. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:24:35.739846 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:24:35.742138 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ed2dc0d-135f-4b1f-a184-533b68ca6e4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:24:35.887824 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-928a3c9c-7945-41b6-ba5e-c80918e60884 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624451 Jun 03 13:24:35.888699 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 196/342] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:24:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:24:35.899865 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8c8fa85c-b5eb-4f0c-973a-77b1efd12e69 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:35.900506 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8c8fa85c-b5eb-4f0c-973a-77b1efd12e69 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:35.955451 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8c8fa85c-b5eb-4f0c-973a-77b1efd12e69 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:35.965795 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8c8fa85c-b5eb-4f0c-973a-77b1efd12e69 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1258 microversion: 2.1 time: 0.069524 Jun 03 13:24:35.969849 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 147/343] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:35 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:36.070153 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f1e495eb-ce9d-4e7f-9f01-2817c002b903 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:36.070775 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f1e495eb-ce9d-4e7f-9f01-2817c002b903 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:36.077526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f1e495eb-ce9d-4e7f-9f01-2817c002b903 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:36.077969 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f1e495eb-ce9d-4e7f-9f01-2817c002b903 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:36.078766 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f1e495eb-ce9d-4e7f-9f01-2817c002b903 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:36.079201 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f1e495eb-ce9d-4e7f-9f01-2817c002b903 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:36.224655 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f1e495eb-ce9d-4e7f-9f01-2817c002b903 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:36.233015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f1e495eb-ce9d-4e7f-9f01-2817c002b903 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1366 microversion: 2.1 time: 0.167434 Jun 03 13:24:36.233593 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 197/344] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:36 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:36.414000 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-fea7f9fc-742b-45f9-ab25-afcc9229214c req-2041680e-6ef8-41e5-9c44-c9e15d59285f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5852e29d-4480-4e14-9e17-d4cccdcb7d1a", "name": "network-vif-plugged", "status": "completed", "tag": "72222d2c-4db5-4768-b158-b370d5e0b875"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:36.422270 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-fea7f9fc-742b-45f9-ab25-afcc9229214c req-2041680e-6ef8-41e5-9c44-c9e15d59285f service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:36.422706 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-fea7f9fc-742b-45f9-ab25-afcc9229214c req-2041680e-6ef8-41e5-9c44-c9e15d59285f service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:36.434321 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-fea7f9fc-742b-45f9-ab25-afcc9229214c req-2041680e-6ef8-41e5-9c44-c9e15d59285f service nova] Creating event network-vif-plugged:72222d2c-4db5-4768-b158-b370d5e0b875 for instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a on hv-cinder-80135 Jun 03 13:24:36.439464 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-fea7f9fc-742b-45f9-ab25-afcc9229214c req-2041680e-6ef8-41e5-9c44-c9e15d59285f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029759 Jun 03 13:24:36.440291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 148/345] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:24:36.982686 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1860b880-e7a7-41c6-9e8b-6a433dda75ee tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:36.983322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-1860b880-e7a7-41c6-9e8b-6a433dda75ee tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:37.034889 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1860b880-e7a7-41c6-9e8b-6a433dda75ee tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:37.041946 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1860b880-e7a7-41c6-9e8b-6a433dda75ee tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1258 microversion: 2.1 time: 0.063104 Jun 03 13:24:37.042942 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 198/346] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:36 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:37.251731 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-03fe7e81-05bf-4a2e-abba-b315a4d66dac tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:37.252518 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-03fe7e81-05bf-4a2e-abba-b315a4d66dac tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:37.259657 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-03fe7e81-05bf-4a2e-abba-b315a4d66dac tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:37.260108 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-03fe7e81-05bf-4a2e-abba-b315a4d66dac tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:37.260898 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-03fe7e81-05bf-4a2e-abba-b315a4d66dac tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:37.261336 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-03fe7e81-05bf-4a2e-abba-b315a4d66dac tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:37.397367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-03fe7e81-05bf-4a2e-abba-b315a4d66dac tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:37.409796 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-03fe7e81-05bf-4a2e-abba-b315a4d66dac tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1366 microversion: 2.1 time: 0.162504 Jun 03 13:24:37.410471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 149/347] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:37 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:38.058873 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2988ea28-c41c-4dcc-ba56-8124db0c656e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:38.059480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2988ea28-c41c-4dcc-ba56-8124db0c656e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:38.065554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2988ea28-c41c-4dcc-ba56-8124db0c656e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:38.066000 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2988ea28-c41c-4dcc-ba56-8124db0c656e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:38.066751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2988ea28-c41c-4dcc-ba56-8124db0c656e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:38.067823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2988ea28-c41c-4dcc-ba56-8124db0c656e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:38.126107 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2988ea28-c41c-4dcc-ba56-8124db0c656e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:38.134217 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2988ea28-c41c-4dcc-ba56-8124db0c656e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1262 microversion: 2.1 time: 0.079244 Jun 03 13:24:38.134775 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 199/348] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:38 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:38.427121 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f34f6758-926c-499a-ad29-37be63c50be1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:38.428288 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f34f6758-926c-499a-ad29-37be63c50be1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:38.435040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f34f6758-926c-499a-ad29-37be63c50be1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:38.435569 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f34f6758-926c-499a-ad29-37be63c50be1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:38.436605 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f34f6758-926c-499a-ad29-37be63c50be1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:38.437229 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f34f6758-926c-499a-ad29-37be63c50be1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:38.570320 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f34f6758-926c-499a-ad29-37be63c50be1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:38.577830 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f34f6758-926c-499a-ad29-37be63c50be1 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1366 microversion: 2.1 time: 0.155127 Jun 03 13:24:38.578395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 150/349] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:38 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:39.153340 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-47ce6605-46b1-4cfe-a333-ac4febf7b97e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:39.153955 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-47ce6605-46b1-4cfe-a333-ac4febf7b97e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:39.159996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47ce6605-46b1-4cfe-a333-ac4febf7b97e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:39.160495 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47ce6605-46b1-4cfe-a333-ac4febf7b97e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:39.162261 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47ce6605-46b1-4cfe-a333-ac4febf7b97e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:39.162710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47ce6605-46b1-4cfe-a333-ac4febf7b97e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:39.225823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-47ce6605-46b1-4cfe-a333-ac4febf7b97e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:39.233353 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-47ce6605-46b1-4cfe-a333-ac4febf7b97e tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1310 microversion: 2.1 time: 0.084014 Jun 03 13:24:39.234116 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 200/350] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:39 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:39.595028 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9b0f8ef4-3f47-40f2-a6ca-979179fc8e93 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:39.595558 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-9b0f8ef4-3f47-40f2-a6ca-979179fc8e93 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:39.602276 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9b0f8ef4-3f47-40f2-a6ca-979179fc8e93 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:39.602721 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9b0f8ef4-3f47-40f2-a6ca-979179fc8e93 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:39.603711 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9b0f8ef4-3f47-40f2-a6ca-979179fc8e93 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:39.604187 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9b0f8ef4-3f47-40f2-a6ca-979179fc8e93 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:39.738472 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9b0f8ef4-3f47-40f2-a6ca-979179fc8e93 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:39.746093 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9b0f8ef4-3f47-40f2-a6ca-979179fc8e93 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1561 microversion: 2.1 time: 0.155110 Jun 03 13:24:39.746673 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 151/351] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:39 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:39.763331 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-50554c19-881f-47b5-8130-6231b5835497 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:39.763821 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-50554c19-881f-47b5-8130-6231b5835497 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:39.769830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-50554c19-881f-47b5-8130-6231b5835497 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:39.770510 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-50554c19-881f-47b5-8130-6231b5835497 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:39.771326 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-50554c19-881f-47b5-8130-6231b5835497 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:39.771741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-50554c19-881f-47b5-8130-6231b5835497 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:39.858635 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-50554c19-881f-47b5-8130-6231b5835497 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099181 Jun 03 13:24:39.859480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 201/352] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 13:24:39 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:24:40.250902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3f168803-0c48-4033-ae68-0b0537fd9666 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:40.251666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3f168803-0c48-4033-ae68-0b0537fd9666 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:40.258265 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3f168803-0c48-4033-ae68-0b0537fd9666 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:40.258820 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3f168803-0c48-4033-ae68-0b0537fd9666 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:40.259681 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3f168803-0c48-4033-ae68-0b0537fd9666 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:40.260240 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3f168803-0c48-4033-ae68-0b0537fd9666 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:40.381490 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3f168803-0c48-4033-ae68-0b0537fd9666 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:40.397821 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3f168803-0c48-4033-ae68-0b0537fd9666 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1316 microversion: 2.1 time: 0.150614 Jun 03 13:24:40.404432 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 152/353] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:40 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:41.419847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8106c608-51f0-4bbc-b8d9-b337ad8a1b3d tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:41.421047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8106c608-51f0-4bbc-b8d9-b337ad8a1b3d tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:41.431678 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8106c608-51f0-4bbc-b8d9-b337ad8a1b3d tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:41.432102 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8106c608-51f0-4bbc-b8d9-b337ad8a1b3d tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:41.435059 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8106c608-51f0-4bbc-b8d9-b337ad8a1b3d tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:41.435059 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8106c608-51f0-4bbc-b8d9-b337ad8a1b3d tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:41.467484 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-63c389cb-085f-45b1-bc6a-f5d2dc78a46e req-17968bbc-16d3-46ff-8ec3-7b08825d5d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5852e29d-4480-4e14-9e17-d4cccdcb7d1a", "tag": "72222d2c-4db5-4768-b158-b370d5e0b875"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:41.477351 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-63c389cb-085f-45b1-bc6a-f5d2dc78a46e req-17968bbc-16d3-46ff-8ec3-7b08825d5d55 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:41.477794 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-63c389cb-085f-45b1-bc6a-f5d2dc78a46e req-17968bbc-16d3-46ff-8ec3-7b08825d5d55 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:41.524581 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-63c389cb-085f-45b1-bc6a-f5d2dc78a46e req-17968bbc-16d3-46ff-8ec3-7b08825d5d55 service nova] Creating event network-changed:72222d2c-4db5-4768-b158-b370d5e0b875 for instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a on hv-cinder-80135 Jun 03 13:24:41.535322 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-63c389cb-085f-45b1-bc6a-f5d2dc78a46e req-17968bbc-16d3-46ff-8ec3-7b08825d5d55 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071673 Jun 03 13:24:41.540210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 153/354] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:24:41.652029 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8106c608-51f0-4bbc-b8d9-b337ad8a1b3d tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:41.659789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8106c608-51f0-4bbc-b8d9-b337ad8a1b3d tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.243859 Jun 03 13:24:41.663923 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 202/355] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:41 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:42.688436 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-21e15450-fcab-47a7-abae-b663552197a4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:42.691050 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-21e15450-fcab-47a7-abae-b663552197a4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:42.706435 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-21e15450-fcab-47a7-abae-b663552197a4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:42.706906 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-21e15450-fcab-47a7-abae-b663552197a4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:42.713005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-21e15450-fcab-47a7-abae-b663552197a4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:42.713605 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-21e15450-fcab-47a7-abae-b663552197a4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:42.864234 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-21e15450-fcab-47a7-abae-b663552197a4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:42.877842 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-21e15450-fcab-47a7-abae-b663552197a4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.198954 Jun 03 13:24:42.878883 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 154/356] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:42 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:43.895904 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-de498fd8-d3f9-428a-b1a0-e2221c5d2fef tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:43.897193 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-de498fd8-d3f9-428a-b1a0-e2221c5d2fef tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:43.903651 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-de498fd8-d3f9-428a-b1a0-e2221c5d2fef tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:43.904109 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-de498fd8-d3f9-428a-b1a0-e2221c5d2fef tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:43.904965 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-de498fd8-d3f9-428a-b1a0-e2221c5d2fef tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:43.905406 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-de498fd8-d3f9-428a-b1a0-e2221c5d2fef tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:44.041902 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-de498fd8-d3f9-428a-b1a0-e2221c5d2fef tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:44.050092 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-de498fd8-d3f9-428a-b1a0-e2221c5d2fef tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.158876 Jun 03 13:24:44.050626 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 203/357] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:43 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:45.068044 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f6cf8e6b-107c-4701-b978-6887d9cc0b02 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:45.069966 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f6cf8e6b-107c-4701-b978-6887d9cc0b02 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:45.076712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f6cf8e6b-107c-4701-b978-6887d9cc0b02 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:45.077450 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f6cf8e6b-107c-4701-b978-6887d9cc0b02 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:45.078386 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f6cf8e6b-107c-4701-b978-6887d9cc0b02 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:45.078979 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f6cf8e6b-107c-4701-b978-6887d9cc0b02 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:45.247458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f6cf8e6b-107c-4701-b978-6887d9cc0b02 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:45.257166 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f6cf8e6b-107c-4701-b978-6887d9cc0b02 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.193924 Jun 03 13:24:45.258702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 155/358] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:45 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:46.274268 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6cc10cb2-97c4-401b-bf7f-bc8430be2fa4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:46.274896 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6cc10cb2-97c4-401b-bf7f-bc8430be2fa4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:46.277734 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:46.281308 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6cc10cb2-97c4-401b-bf7f-bc8430be2fa4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:46.281757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6cc10cb2-97c4-401b-bf7f-bc8430be2fa4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:46.282519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6cc10cb2-97c4-401b-bf7f-bc8430be2fa4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:46.283038 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6cc10cb2-97c4-401b-bf7f-bc8430be2fa4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:46.411621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6cc10cb2-97c4-401b-bf7f-bc8430be2fa4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:46.418899 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6cc10cb2-97c4-401b-bf7f-bc8430be2fa4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.148674 Jun 03 13:24:46.419457 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 204/359] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:46 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:47.437665 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-19967c21-3f5c-4791-ba12-42454cb83a60 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:47.439219 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-19967c21-3f5c-4791-ba12-42454cb83a60 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:47.441470 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=6 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:47.447465 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19967c21-3f5c-4791-ba12-42454cb83a60 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:47.448933 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19967c21-3f5c-4791-ba12-42454cb83a60 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:47.448933 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19967c21-3f5c-4791-ba12-42454cb83a60 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:47.449401 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19967c21-3f5c-4791-ba12-42454cb83a60 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:47.632692 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-19967c21-3f5c-4791-ba12-42454cb83a60 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:47.640783 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-19967c21-3f5c-4791-ba12-42454cb83a60 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.208842 Jun 03 13:24:47.641362 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 156/360] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:47 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:48.658016 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-936da999-7579-4feb-892f-bfea2913bda6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:48.658642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-936da999-7579-4feb-892f-bfea2913bda6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:48.660847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=8 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:48.665628 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-936da999-7579-4feb-892f-bfea2913bda6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:48.666078 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-936da999-7579-4feb-892f-bfea2913bda6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:48.666836 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-936da999-7579-4feb-892f-bfea2913bda6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:48.667278 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-936da999-7579-4feb-892f-bfea2913bda6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:48.805218 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-936da999-7579-4feb-892f-bfea2913bda6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:48.813413 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-936da999-7579-4feb-892f-bfea2913bda6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.159058 Jun 03 13:24:48.814511 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 205/361] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:48 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:24:49.833834 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-12b09f8d-5aca-48a3-907f-04fff6e3c748 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:49.834464 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-12b09f8d-5aca-48a3-907f-04fff6e3c748 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:49.841136 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-12b09f8d-5aca-48a3-907f-04fff6e3c748 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:49.841587 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-12b09f8d-5aca-48a3-907f-04fff6e3c748 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:49.842346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-12b09f8d-5aca-48a3-907f-04fff6e3c748 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:49.842785 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-12b09f8d-5aca-48a3-907f-04fff6e3c748 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:49.973256 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-12b09f8d-5aca-48a3-907f-04fff6e3c748 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:49.980745 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-12b09f8d-5aca-48a3-907f-04fff6e3c748 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.151846 Jun 03 13:24:49.981312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 157/362] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:49 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:50.998132 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-03e60502-1c4f-4e7e-956a-8cb80221d837 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:50.998746 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-03e60502-1c4f-4e7e-956a-8cb80221d837 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:51.000602 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:51.005800 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-03e60502-1c4f-4e7e-956a-8cb80221d837 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:51.006255 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-03e60502-1c4f-4e7e-956a-8cb80221d837 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:51.007609 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-03e60502-1c4f-4e7e-956a-8cb80221d837 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:51.008057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-03e60502-1c4f-4e7e-956a-8cb80221d837 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:51.137728 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-03e60502-1c4f-4e7e-956a-8cb80221d837 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:51.145828 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-03e60502-1c4f-4e7e-956a-8cb80221d837 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.151521 Jun 03 13:24:51.146393 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 206/363] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:50 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:52.163650 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ff90ec5f-8aba-4e44-8ba6-4dda38c6b563 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:52.164433 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ff90ec5f-8aba-4e44-8ba6-4dda38c6b563 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:52.170940 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ff90ec5f-8aba-4e44-8ba6-4dda38c6b563 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:52.171385 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ff90ec5f-8aba-4e44-8ba6-4dda38c6b563 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:52.172168 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ff90ec5f-8aba-4e44-8ba6-4dda38c6b563 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:52.172599 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ff90ec5f-8aba-4e44-8ba6-4dda38c6b563 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:52.304853 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ff90ec5f-8aba-4e44-8ba6-4dda38c6b563 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:52.312501 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ff90ec5f-8aba-4e44-8ba6-4dda38c6b563 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.154033 Jun 03 13:24:52.313056 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 158/364] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:52 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:53.333077 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-520c48be-a0dd-467e-bd40-d85f57f33b9c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:53.334013 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-520c48be-a0dd-467e-bd40-d85f57f33b9c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:53.343721 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-520c48be-a0dd-467e-bd40-d85f57f33b9c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:53.344338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-520c48be-a0dd-467e-bd40-d85f57f33b9c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:53.345221 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-520c48be-a0dd-467e-bd40-d85f57f33b9c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:53.345747 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-520c48be-a0dd-467e-bd40-d85f57f33b9c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:53.473843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-520c48be-a0dd-467e-bd40-d85f57f33b9c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:53.481307 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-520c48be-a0dd-467e-bd40-d85f57f33b9c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.155594 Jun 03 13:24:53.481860 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 207/365] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:53 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:54.498903 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-43012c96-8aaa-46b3-9b3c-cc77d34564bb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:54.505429 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-43012c96-8aaa-46b3-9b3c-cc77d34564bb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:54.506675 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-43012c96-8aaa-46b3-9b3c-cc77d34564bb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:54.507121 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-43012c96-8aaa-46b3-9b3c-cc77d34564bb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:54.507886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-43012c96-8aaa-46b3-9b3c-cc77d34564bb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:54.508353 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-43012c96-8aaa-46b3-9b3c-cc77d34564bb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:54.642597 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-43012c96-8aaa-46b3-9b3c-cc77d34564bb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:54.650752 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-43012c96-8aaa-46b3-9b3c-cc77d34564bb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.156031 Jun 03 13:24:54.653920 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 159/366] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:54 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:55.667330 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-cc7a6034-f8d2-4583-a145-b011cfd55f1a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:55.667932 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-cc7a6034-f8d2-4583-a145-b011cfd55f1a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:55.673875 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cc7a6034-f8d2-4583-a145-b011cfd55f1a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:55.674317 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cc7a6034-f8d2-4583-a145-b011cfd55f1a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:55.675067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cc7a6034-f8d2-4583-a145-b011cfd55f1a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:55.675673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cc7a6034-f8d2-4583-a145-b011cfd55f1a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:55.679857 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=96 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:55.815782 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cc7a6034-f8d2-4583-a145-b011cfd55f1a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:55.823919 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-cc7a6034-f8d2-4583-a145-b011cfd55f1a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.160453 Jun 03 13:24:55.824670 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 208/367] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:55 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:56.841478 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e276f7e8-ca38-4ce0-a434-adccd63e1276 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:56.842127 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e276f7e8-ca38-4ce0-a434-adccd63e1276 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:56.844526 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:56.850058 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e276f7e8-ca38-4ce0-a434-adccd63e1276 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:56.850500 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e276f7e8-ca38-4ce0-a434-adccd63e1276 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:56.851362 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e276f7e8-ca38-4ce0-a434-adccd63e1276 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:56.851799 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e276f7e8-ca38-4ce0-a434-adccd63e1276 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:56.869798 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=100 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:56.986411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e276f7e8-ca38-4ce0-a434-adccd63e1276 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:56.994433 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e276f7e8-ca38-4ce0-a434-adccd63e1276 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.156812 Jun 03 13:24:56.995007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 160/368] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:56 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:58.011055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6e0dab86-debf-47c1-8260-5a16671caadf tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:58.011655 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6e0dab86-debf-47c1-8260-5a16671caadf tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:58.017805 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6e0dab86-debf-47c1-8260-5a16671caadf tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:58.018253 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6e0dab86-debf-47c1-8260-5a16671caadf tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:58.019364 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6e0dab86-debf-47c1-8260-5a16671caadf tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:58.019461 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6e0dab86-debf-47c1-8260-5a16671caadf tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:58.149843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6e0dab86-debf-47c1-8260-5a16671caadf tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:58.157233 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6e0dab86-debf-47c1-8260-5a16671caadf tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.150072 Jun 03 13:24:58.157795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 209/369] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:58 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:59.175491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d82f3d77-139a-4a4c-8dd9-7ab5d8550a2f tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:59.176807 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d82f3d77-139a-4a4c-8dd9-7ab5d8550a2f tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:59.185171 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d82f3d77-139a-4a4c-8dd9-7ab5d8550a2f tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:59.185616 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d82f3d77-139a-4a4c-8dd9-7ab5d8550a2f tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:59.186381 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d82f3d77-139a-4a4c-8dd9-7ab5d8550a2f tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:59.186952 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d82f3d77-139a-4a4c-8dd9-7ab5d8550a2f tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:59.247123 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-d4c6d2c6-5876-4004-ace7-f15fa78d3c65 req-963808f1-a3d3-4144-b83d-09c13616e6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfaaead1-3faf-4b34-a756-3d1cc7e7d19d", "tag": "6643f089-18b4-4d4c-8781-ba618ecca2fe"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:59.257543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-d4c6d2c6-5876-4004-ace7-f15fa78d3c65 req-963808f1-a3d3-4144-b83d-09c13616e6b6 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:59.257989 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-d4c6d2c6-5876-4004-ace7-f15fa78d3c65 req-963808f1-a3d3-4144-b83d-09c13616e6b6 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:59.298240 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-d4c6d2c6-5876-4004-ace7-f15fa78d3c65 req-963808f1-a3d3-4144-b83d-09c13616e6b6 service nova] Creating event network-changed:6643f089-18b4-4d4c-8781-ba618ecca2fe for instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d on hv-cinder-80135 Jun 03 13:24:59.311279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-d4c6d2c6-5876-4004-ace7-f15fa78d3c65 req-963808f1-a3d3-4144-b83d-09c13616e6b6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067889 Jun 03 13:24:59.312047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 210/370] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:24:59.433973 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d82f3d77-139a-4a4c-8dd9-7ab5d8550a2f tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:59.442487 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d82f3d77-139a-4a4c-8dd9-7ab5d8550a2f tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.271821 Jun 03 13:24:59.443826 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 161/371] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:59 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:00.461168 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3acedb24-4fb6-4f83-b673-baa27d4c0622 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:00.462619 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3acedb24-4fb6-4f83-b673-baa27d4c0622 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:00.467966 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3acedb24-4fb6-4f83-b673-baa27d4c0622 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:00.468512 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3acedb24-4fb6-4f83-b673-baa27d4c0622 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:00.469270 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3acedb24-4fb6-4f83-b673-baa27d4c0622 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:00.469707 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3acedb24-4fb6-4f83-b673-baa27d4c0622 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:00.617962 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3acedb24-4fb6-4f83-b673-baa27d4c0622 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:00.625716 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3acedb24-4fb6-4f83-b673-baa27d4c0622 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.169554 Jun 03 13:25:00.626282 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 211/372] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:00 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:01.642841 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-12d528c9-c147-4082-909b-9c8602829d4c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:01.643468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-12d528c9-c147-4082-909b-9c8602829d4c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:01.650660 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-12d528c9-c147-4082-909b-9c8602829d4c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:01.651110 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-12d528c9-c147-4082-909b-9c8602829d4c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:01.651926 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-12d528c9-c147-4082-909b-9c8602829d4c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:01.652388 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-12d528c9-c147-4082-909b-9c8602829d4c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:01.779374 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-12d528c9-c147-4082-909b-9c8602829d4c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:01.786717 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-12d528c9-c147-4082-909b-9c8602829d4c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.147777 Jun 03 13:25:01.787282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 162/373] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:01 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:02.804132 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ddeb5039-5c2a-4ed8-992e-2813ffb4a879 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:02.806217 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ddeb5039-5c2a-4ed8-992e-2813ffb4a879 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:02.811185 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ddeb5039-5c2a-4ed8-992e-2813ffb4a879 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:02.811944 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ddeb5039-5c2a-4ed8-992e-2813ffb4a879 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:02.812743 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ddeb5039-5c2a-4ed8-992e-2813ffb4a879 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:02.813175 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ddeb5039-5c2a-4ed8-992e-2813ffb4a879 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:02.939730 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ddeb5039-5c2a-4ed8-992e-2813ffb4a879 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:02.947174 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ddeb5039-5c2a-4ed8-992e-2813ffb4a879 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.147960 Jun 03 13:25:02.947737 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 212/374] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:02 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:03.964094 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-43458f02-9197-48be-955f-4ed75bb432e4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:03.964812 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-43458f02-9197-48be-955f-4ed75bb432e4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:03.971092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-43458f02-9197-48be-955f-4ed75bb432e4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:03.971541 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-43458f02-9197-48be-955f-4ed75bb432e4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:03.972326 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-43458f02-9197-48be-955f-4ed75bb432e4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:03.972911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-43458f02-9197-48be-955f-4ed75bb432e4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:04.101388 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-43458f02-9197-48be-955f-4ed75bb432e4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:04.108789 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-43458f02-9197-48be-955f-4ed75bb432e4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.148545 Jun 03 13:25:04.109357 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 163/375] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:03 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:05.125129 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0bd7e85a-e016-42d3-b64d-1c3dc5222b63 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:05.125741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0bd7e85a-e016-42d3-b64d-1c3dc5222b63 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:05.132741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0bd7e85a-e016-42d3-b64d-1c3dc5222b63 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:05.133195 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0bd7e85a-e016-42d3-b64d-1c3dc5222b63 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:05.133951 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0bd7e85a-e016-42d3-b64d-1c3dc5222b63 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:05.134388 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0bd7e85a-e016-42d3-b64d-1c3dc5222b63 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:05.262398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0bd7e85a-e016-42d3-b64d-1c3dc5222b63 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:05.269714 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0bd7e85a-e016-42d3-b64d-1c3dc5222b63 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.148422 Jun 03 13:25:05.270412 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 213/376] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:05 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:06.286372 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1588f9fe-39ca-4418-a157-00a2d71484b4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:06.286913 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-1588f9fe-39ca-4418-a157-00a2d71484b4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:06.293429 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1588f9fe-39ca-4418-a157-00a2d71484b4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:06.293874 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1588f9fe-39ca-4418-a157-00a2d71484b4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:06.294628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1588f9fe-39ca-4418-a157-00a2d71484b4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:06.295060 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1588f9fe-39ca-4418-a157-00a2d71484b4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:06.419746 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-1588f9fe-39ca-4418-a157-00a2d71484b4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:06.427146 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-1588f9fe-39ca-4418-a157-00a2d71484b4 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.144734 Jun 03 13:25:06.427713 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 164/377] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:06 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:07.443139 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2fa02d4a-954b-4f4a-8c80-a0c2a037ad04 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:07.443663 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2fa02d4a-954b-4f4a-8c80-a0c2a037ad04 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:07.449836 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2fa02d4a-954b-4f4a-8c80-a0c2a037ad04 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:07.450281 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2fa02d4a-954b-4f4a-8c80-a0c2a037ad04 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:07.451037 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2fa02d4a-954b-4f4a-8c80-a0c2a037ad04 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:07.451476 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2fa02d4a-954b-4f4a-8c80-a0c2a037ad04 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:07.579210 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2fa02d4a-954b-4f4a-8c80-a0c2a037ad04 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:07.587216 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2fa02d4a-954b-4f4a-8c80-a0c2a037ad04 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.148049 Jun 03 13:25:07.593837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 214/378] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:07 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:08.604511 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-22519991-466d-41ae-b48d-59d0e5229b99 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:08.605119 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-22519991-466d-41ae-b48d-59d0e5229b99 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:08.611523 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-22519991-466d-41ae-b48d-59d0e5229b99 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:08.611966 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-22519991-466d-41ae-b48d-59d0e5229b99 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:08.612759 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-22519991-466d-41ae-b48d-59d0e5229b99 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:08.613193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-22519991-466d-41ae-b48d-59d0e5229b99 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:08.741052 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-22519991-466d-41ae-b48d-59d0e5229b99 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:08.748765 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-22519991-466d-41ae-b48d-59d0e5229b99 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.148227 Jun 03 13:25:08.749320 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 165/379] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:08 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:09.766015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f0ecb6ee-3416-45e4-9f44-3681bb50a6aa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:09.766652 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f0ecb6ee-3416-45e4-9f44-3681bb50a6aa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:09.773375 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f0ecb6ee-3416-45e4-9f44-3681bb50a6aa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:09.773825 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f0ecb6ee-3416-45e4-9f44-3681bb50a6aa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:09.774580 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f0ecb6ee-3416-45e4-9f44-3681bb50a6aa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:09.775015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f0ecb6ee-3416-45e4-9f44-3681bb50a6aa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:09.904176 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f0ecb6ee-3416-45e4-9f44-3681bb50a6aa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:09.911590 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f0ecb6ee-3416-45e4-9f44-3681bb50a6aa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.149482 Jun 03 13:25:09.913217 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 215/380] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:09 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:10.930324 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-67214b75-7ad4-4251-b4a5-9ca601a845a0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:10.930905 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-67214b75-7ad4-4251-b4a5-9ca601a845a0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:10.937410 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-67214b75-7ad4-4251-b4a5-9ca601a845a0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:10.937851 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-67214b75-7ad4-4251-b4a5-9ca601a845a0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:10.938600 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-67214b75-7ad4-4251-b4a5-9ca601a845a0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:10.939026 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-67214b75-7ad4-4251-b4a5-9ca601a845a0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:11.067310 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-67214b75-7ad4-4251-b4a5-9ca601a845a0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:11.074722 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-67214b75-7ad4-4251-b4a5-9ca601a845a0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.149081 Jun 03 13:25:11.075285 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 166/381] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:10 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:12.092022 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-08e130df-ca8a-417c-bb4b-eabd5535b23b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:12.092670 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-08e130df-ca8a-417c-bb4b-eabd5535b23b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:12.098610 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-08e130df-ca8a-417c-bb4b-eabd5535b23b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:12.099048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-08e130df-ca8a-417c-bb4b-eabd5535b23b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:12.099792 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-08e130df-ca8a-417c-bb4b-eabd5535b23b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:12.100263 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-08e130df-ca8a-417c-bb4b-eabd5535b23b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:12.224913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-08e130df-ca8a-417c-bb4b-eabd5535b23b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:12.232319 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-08e130df-ca8a-417c-bb4b-eabd5535b23b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.144059 Jun 03 13:25:12.232882 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 216/382] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:12 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:13.250166 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b194e08c-36eb-4a92-a3cc-9fb227f45767 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:13.250770 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b194e08c-36eb-4a92-a3cc-9fb227f45767 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:13.257908 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b194e08c-36eb-4a92-a3cc-9fb227f45767 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:13.258297 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b194e08c-36eb-4a92-a3cc-9fb227f45767 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:13.259092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b194e08c-36eb-4a92-a3cc-9fb227f45767 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:13.259628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b194e08c-36eb-4a92-a3cc-9fb227f45767 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:13.390100 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b194e08c-36eb-4a92-a3cc-9fb227f45767 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:13.397675 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b194e08c-36eb-4a92-a3cc-9fb227f45767 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.151309 Jun 03 13:25:13.398229 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 167/383] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:13 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:14.136052 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4024d17f-e586-4b3e-8d92-8c126bfa6fe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:14.136607 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4024d17f-e586-4b3e-8d92-8c126bfa6fe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:14.142536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4024d17f-e586-4b3e-8d92-8c126bfa6fe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:14.142974 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4024d17f-e586-4b3e-8d92-8c126bfa6fe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:14.143717 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4024d17f-e586-4b3e-8d92-8c126bfa6fe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:14.144164 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4024d17f-e586-4b3e-8d92-8c126bfa6fe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:14.167269 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4024d17f-e586-4b3e-8d92-8c126bfa6fe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/ips" status: 200 len: 153 microversion: 2.20 time: 0.035156 Jun 03 13:25:14.167817 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 217/384] 10.222.0.61 () {60 vars in 1288 bytes} [Fri Jun 3 13:25:14 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/ips => generated 153 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:25:14.413900 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ee89eaba-1d9b-4a8f-a263-c17371dbf896 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:14.414475 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ee89eaba-1d9b-4a8f-a263-c17371dbf896 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:14.420806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ee89eaba-1d9b-4a8f-a263-c17371dbf896 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:14.421254 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ee89eaba-1d9b-4a8f-a263-c17371dbf896 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:14.422000 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ee89eaba-1d9b-4a8f-a263-c17371dbf896 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:14.422426 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ee89eaba-1d9b-4a8f-a263-c17371dbf896 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:14.554793 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ee89eaba-1d9b-4a8f-a263-c17371dbf896 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:14.562325 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ee89eaba-1d9b-4a8f-a263-c17371dbf896 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.152543 Jun 03 13:25:14.562895 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 168/385] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:14 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:15.578839 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ac3c6d46-312c-41e6-8a81-0eac912b034b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:15.579444 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ac3c6d46-312c-41e6-8a81-0eac912b034b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:15.585727 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac3c6d46-312c-41e6-8a81-0eac912b034b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:15.586178 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac3c6d46-312c-41e6-8a81-0eac912b034b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:15.586935 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac3c6d46-312c-41e6-8a81-0eac912b034b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:15.587368 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac3c6d46-312c-41e6-8a81-0eac912b034b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:15.721905 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ac3c6d46-312c-41e6-8a81-0eac912b034b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:15.733119 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ac3c6d46-312c-41e6-8a81-0eac912b034b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.158165 Jun 03 13:25:15.733691 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 218/386] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:15 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:16.088038 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:25:16.088233 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Fri Jun 3 13:25:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:25:16.430512 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ba3001bc-8cda-4c73-8746-4cff72715964 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:16.431081 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ba3001bc-8cda-4c73-8746-4cff72715964 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:16.437620 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ba3001bc-8cda-4c73-8746-4cff72715964 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:16.438074 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ba3001bc-8cda-4c73-8746-4cff72715964 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:16.438839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ba3001bc-8cda-4c73-8746-4cff72715964 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:16.443396 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ba3001bc-8cda-4c73-8746-4cff72715964 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:16.462857 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ba3001bc-8cda-4c73-8746-4cff72715964 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/ips" status: 200 len: 145 microversion: 2.1 time: 0.036881 Jun 03 13:25:16.463423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 169/387] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 13:25:16 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:16.754827 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4adede08-445e-49f4-8301-79f00f68b284 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:16.755493 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4adede08-445e-49f4-8301-79f00f68b284 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:16.761975 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4adede08-445e-49f4-8301-79f00f68b284 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:16.762430 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4adede08-445e-49f4-8301-79f00f68b284 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:16.763191 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4adede08-445e-49f4-8301-79f00f68b284 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:16.763634 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4adede08-445e-49f4-8301-79f00f68b284 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:16.802160 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-4528b5ef-3799-43d6-9471-e8b0c76d339e req-5728aea7-d784-4561-b4f9-3d8f8b6de2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfaaead1-3faf-4b34-a756-3d1cc7e7d19d", "name": "network-vif-plugged", "status": "completed", "tag": "6643f089-18b4-4d4c-8781-ba618ecca2fe"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:16.810945 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-4528b5ef-3799-43d6-9471-e8b0c76d339e req-5728aea7-d784-4561-b4f9-3d8f8b6de2a5 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:16.811390 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-4528b5ef-3799-43d6-9471-e8b0c76d339e req-5728aea7-d784-4561-b4f9-3d8f8b6de2a5 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:16.825079 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-4528b5ef-3799-43d6-9471-e8b0c76d339e req-5728aea7-d784-4561-b4f9-3d8f8b6de2a5 service nova] Creating event network-vif-plugged:6643f089-18b4-4d4c-8781-ba618ecca2fe for instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d on hv-cinder-80135 Jun 03 13:25:16.830475 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-4528b5ef-3799-43d6-9471-e8b0c76d339e req-5728aea7-d784-4561-b4f9-3d8f8b6de2a5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031855 Jun 03 13:25:16.831326 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 170/388] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:25:16.899115 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4adede08-445e-49f4-8301-79f00f68b284 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:16.906814 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4adede08-445e-49f4-8301-79f00f68b284 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.155889 Jun 03 13:25:16.907375 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 219/389] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:16 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:17.557758 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-57cf05c1-2adb-4b3e-a540-8b86212bedb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:17.558372 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-57cf05c1-2adb-4b3e-a540-8b86212bedb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:17.564587 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-57cf05c1-2adb-4b3e-a540-8b86212bedb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:17.568393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-57cf05c1-2adb-4b3e-a540-8b86212bedb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:17.568393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-57cf05c1-2adb-4b3e-a540-8b86212bedb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:17.568393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-57cf05c1-2adb-4b3e-a540-8b86212bedb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:17.589112 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-57cf05c1-2adb-4b3e-a540-8b86212bedb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lazy-loading 'flavor' on Instance uuid 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:25:17.924300 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1f0c46b7-536d-4320-a648-8dd76df417f5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:17.925491 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-1f0c46b7-536d-4320-a648-8dd76df417f5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:17.932175 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1f0c46b7-536d-4320-a648-8dd76df417f5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:17.932647 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1f0c46b7-536d-4320-a648-8dd76df417f5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:17.933396 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1f0c46b7-536d-4320-a648-8dd76df417f5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:17.934084 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1f0c46b7-536d-4320-a648-8dd76df417f5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:18.070376 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1f0c46b7-536d-4320-a648-8dd76df417f5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:18.077918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1f0c46b7-536d-4320-a648-8dd76df417f5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1358 microversion: 2.1 time: 0.157740 Jun 03 13:25:18.078411 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 220/390] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:17 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:25:18.152640 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-57cf05c1-2adb-4b3e-a540-8b86212bedb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "POST /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/action" status: 202 len: 0 microversion: 2.20 time: 0.599415 Jun 03 13:25:18.157527 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 171/391] 10.222.0.61 () {62 vars in 1318 bytes} [Fri Jun 3 13:25:17 2022] POST /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:25:18.161579 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8c1caeba-1a71-4205-96ef-abed23865fd8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:18.162184 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8c1caeba-1a71-4205-96ef-abed23865fd8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:18.168747 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8c1caeba-1a71-4205-96ef-abed23865fd8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:18.169193 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8c1caeba-1a71-4205-96ef-abed23865fd8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:18.169957 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8c1caeba-1a71-4205-96ef-abed23865fd8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:18.170394 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8c1caeba-1a71-4205-96ef-abed23865fd8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:18.305496 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8c1caeba-1a71-4205-96ef-abed23865fd8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:18.314972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8c1caeba-1a71-4205-96ef-abed23865fd8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:18.316585 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8c1caeba-1a71-4205-96ef-abed23865fd8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:18.317741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8c1caeba-1a71-4205-96ef-abed23865fd8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.160100 Jun 03 13:25:18.318773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 221/392] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:18 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:19.095855 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ab193583-c0c4-4bab-8459-80b3c4e905b1 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:19.096588 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ab193583-c0c4-4bab-8459-80b3c4e905b1 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:19.104722 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab193583-c0c4-4bab-8459-80b3c4e905b1 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:19.104722 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab193583-c0c4-4bab-8459-80b3c4e905b1 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:19.105533 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab193583-c0c4-4bab-8459-80b3c4e905b1 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:19.105979 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab193583-c0c4-4bab-8459-80b3c4e905b1 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:19.242344 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ab193583-c0c4-4bab-8459-80b3c4e905b1 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:19.250072 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ab193583-c0c4-4bab-8459-80b3c4e905b1 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1548 microversion: 2.1 time: 0.159111 Jun 03 13:25:19.250637 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 172/393] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:19 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:19.266406 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3edf894e-3df5-41c9-8c02-08124819089a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:19.267021 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3edf894e-3df5-41c9-8c02-08124819089a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:19.273618 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3edf894e-3df5-41c9-8c02-08124819089a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:19.274064 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3edf894e-3df5-41c9-8c02-08124819089a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:19.274816 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3edf894e-3df5-41c9-8c02-08124819089a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:19.275253 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3edf894e-3df5-41c9-8c02-08124819089a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:19.336133 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e161011b-2303-4256-8122-28b25d4ad7ab tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:19.336762 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e161011b-2303-4256-8122-28b25d4ad7ab tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:19.342999 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e161011b-2303-4256-8122-28b25d4ad7ab tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:19.343651 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e161011b-2303-4256-8122-28b25d4ad7ab tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:19.344453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e161011b-2303-4256-8122-28b25d4ad7ab tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:19.344884 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e161011b-2303-4256-8122-28b25d4ad7ab tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:19.422980 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3edf894e-3df5-41c9-8c02-08124819089a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:19.431401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3edf894e-3df5-41c9-8c02-08124819089a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1548 microversion: 2.1 time: 0.168793 Jun 03 13:25:19.432773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 222/394] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:19 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:19.450821 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5ae1c535-08e8-4175-807b-8669cf4d19df tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:19.454711 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5ae1c535-08e8-4175-807b-8669cf4d19df tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:19.455481 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5ae1c535-08e8-4175-807b-8669cf4d19df tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Searching by: {'deleted': False, 'project_id': '03432cb8c28c46fba16dc9f88d648d11'} {{(pid=118179) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 03 13:25:19.463011 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ae1c535-08e8-4175-807b-8669cf4d19df tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:19.463510 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ae1c535-08e8-4175-807b-8669cf4d19df tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:19.464278 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ae1c535-08e8-4175-807b-8669cf4d19df tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:19.464716 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ae1c535-08e8-4175-807b-8669cf4d19df tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:19.494339 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e161011b-2303-4256-8122-28b25d4ad7ab tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:19.503996 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e161011b-2303-4256-8122-28b25d4ad7ab tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:19.505788 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e161011b-2303-4256-8122-28b25d4ad7ab tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:19.507038 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e161011b-2303-4256-8122-28b25d4ad7ab tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.174781 Jun 03 13:25:19.507800 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 173/395] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:19 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:19.563197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.multi_cell_list [None req-5ae1c535-08e8-4175-807b-8669cf4d19df tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118179) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 03 13:25:19.669856 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5ae1c535-08e8-4175-807b-8669cf4d19df tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.223266 Jun 03 13:25:19.670498 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 223/396] 10.222.0.61 () {58 vars in 1124 bytes} [Fri Jun 3 13:25:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:19.680673 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-00a7e923-14ef-4ef8-9238-586373b4bf8a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:19.681303 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-00a7e923-14ef-4ef8-9238-586373b4bf8a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:19.687870 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-00a7e923-14ef-4ef8-9238-586373b4bf8a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:19.688353 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-00a7e923-14ef-4ef8-9238-586373b4bf8a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:19.692520 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-00a7e923-14ef-4ef8-9238-586373b4bf8a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:19.692520 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-00a7e923-14ef-4ef8-9238-586373b4bf8a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:19.821306 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-00a7e923-14ef-4ef8-9238-586373b4bf8a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:19.828847 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-00a7e923-14ef-4ef8-9238-586373b4bf8a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1548 microversion: 2.1 time: 0.151931 Jun 03 13:25:19.829411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 174/397] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:19 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:20.527270 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b4f62a20-b003-44ba-b545-468623b56c8d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:20.528072 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b4f62a20-b003-44ba-b545-468623b56c8d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:20.535603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4f62a20-b003-44ba-b545-468623b56c8d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:20.536183 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4f62a20-b003-44ba-b545-468623b56c8d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:20.537019 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4f62a20-b003-44ba-b545-468623b56c8d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:20.537476 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4f62a20-b003-44ba-b545-468623b56c8d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:20.674739 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b4f62a20-b003-44ba-b545-468623b56c8d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:20.682731 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b4f62a20-b003-44ba-b545-468623b56c8d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:20.684311 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b4f62a20-b003-44ba-b545-468623b56c8d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:20.685506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b4f62a20-b003-44ba-b545-468623b56c8d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.163727 Jun 03 13:25:20.686062 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 224/398] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:20 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:20.920406 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4ca5276f-fbeb-46a7-9dbb-047171dbec46 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1a657d5-c351-479d-8371-3422fc66a696"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:20.921622 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4ca5276f-fbeb-46a7-9dbb-047171dbec46 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:20.927665 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ca5276f-fbeb-46a7-9dbb-047171dbec46 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:20.928103 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ca5276f-fbeb-46a7-9dbb-047171dbec46 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:20.928994 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ca5276f-fbeb-46a7-9dbb-047171dbec46 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:20.929423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ca5276f-fbeb-46a7-9dbb-047171dbec46 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:21.227842 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-46d02be2-a3ff-432f-b180-7fe24a9bf98e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:21.228345 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-46d02be2-a3ff-432f-b180-7fe24a9bf98e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:21.231495 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=38 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:21.234890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-46d02be2-a3ff-432f-b180-7fe24a9bf98e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:21.235336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-46d02be2-a3ff-432f-b180-7fe24a9bf98e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:21.236087 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-46d02be2-a3ff-432f-b180-7fe24a9bf98e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:21.236539 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-46d02be2-a3ff-432f-b180-7fe24a9bf98e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:21.251200 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:21.261596 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-46d02be2-a3ff-432f-b180-7fe24a9bf98e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/ips" status: 200 len: 151 microversion: 2.1 time: 0.038054 Jun 03 13:25:21.262162 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 225/399] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 13:25:21 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:25:21.516263 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:21.704867 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0008539a-1f59-4911-98c1-0bcea8421483 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:21.705467 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0008539a-1f59-4911-98c1-0bcea8421483 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:21.712792 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0008539a-1f59-4911-98c1-0bcea8421483 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:21.713244 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0008539a-1f59-4911-98c1-0bcea8421483 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:21.714044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0008539a-1f59-4911-98c1-0bcea8421483 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:21.714476 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0008539a-1f59-4911-98c1-0bcea8421483 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:21.845095 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0008539a-1f59-4911-98c1-0bcea8421483 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:21.854045 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0008539a-1f59-4911-98c1-0bcea8421483 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:21.855556 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0008539a-1f59-4911-98c1-0bcea8421483 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:21.856739 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0008539a-1f59-4911-98c1-0bcea8421483 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.156175 Jun 03 13:25:21.857291 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 226/400] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:21 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:22.630682 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4ca5276f-fbeb-46a7-9dbb-047171dbec46 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "POST /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.714484 Jun 03 13:25:22.631549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 175/401] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:25:20 2022] POST /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/os-volume_attachments => generated 194 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:22.877373 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-fb1ad62d-fd55-47b1-a22e-d6de5e99fa68 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:22.878523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-fb1ad62d-fd55-47b1-a22e-d6de5e99fa68 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:22.892956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fb1ad62d-fd55-47b1-a22e-d6de5e99fa68 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:22.893841 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fb1ad62d-fd55-47b1-a22e-d6de5e99fa68 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:22.894686 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fb1ad62d-fd55-47b1-a22e-d6de5e99fa68 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:22.895130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fb1ad62d-fd55-47b1-a22e-d6de5e99fa68 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:23.027327 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fb1ad62d-fd55-47b1-a22e-d6de5e99fa68 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:23.035189 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fb1ad62d-fd55-47b1-a22e-d6de5e99fa68 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:23.036739 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fb1ad62d-fd55-47b1-a22e-d6de5e99fa68 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:23.037878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-fb1ad62d-fd55-47b1-a22e-d6de5e99fa68 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.166160 Jun 03 13:25:23.038477 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 227/402] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:22 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:23.298798 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-553470fb-7fd4-4f37-b5cc-96cc972a16c5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "604ab98b-523f-43e7-9acf-30f74b3d830b"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:23.299999 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-553470fb-7fd4-4f37-b5cc-96cc972a16c5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:23.306755 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-553470fb-7fd4-4f37-b5cc-96cc972a16c5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:23.307200 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-553470fb-7fd4-4f37-b5cc-96cc972a16c5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:23.308021 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-553470fb-7fd4-4f37-b5cc-96cc972a16c5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:23.308483 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-553470fb-7fd4-4f37-b5cc-96cc972a16c5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:24.055868 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b2e1a5b9-37a5-4e4f-9eb6-9d471e814b58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:24.056495 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b2e1a5b9-37a5-4e4f-9eb6-9d471e814b58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:24.062484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b2e1a5b9-37a5-4e4f-9eb6-9d471e814b58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:24.062933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b2e1a5b9-37a5-4e4f-9eb6-9d471e814b58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:24.063686 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b2e1a5b9-37a5-4e4f-9eb6-9d471e814b58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:24.064119 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b2e1a5b9-37a5-4e4f-9eb6-9d471e814b58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:24.199705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b2e1a5b9-37a5-4e4f-9eb6-9d471e814b58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:24.207925 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b2e1a5b9-37a5-4e4f-9eb6-9d471e814b58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:24.209506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b2e1a5b9-37a5-4e4f-9eb6-9d471e814b58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:24.210656 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b2e1a5b9-37a5-4e4f-9eb6-9d471e814b58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.159232 Jun 03 13:25:24.211216 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 228/403] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:24 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:24.375176 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-397428232", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452"}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:24.383848 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-553470fb-7fd4-4f37-b5cc-96cc972a16c5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "POST /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.089267 Jun 03 13:25:24.388556 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 176/404] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:25:23 2022] POST /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments => generated 194 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:24.428383 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] validate_networks() for None {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:25:24.616086 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-837b3a87-949c-493a-a9a4-437fb2a663a9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "333386db-53ba-416f-b0fa-d9a0cfb16fb2"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:24.624821 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-837b3a87-949c-493a-a9a4-437fb2a663a9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:24.634699 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-837b3a87-949c-493a-a9a4-437fb2a663a9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:24.635281 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-837b3a87-949c-493a-a9a4-437fb2a663a9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:24.636156 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-837b3a87-949c-493a-a9a4-437fb2a663a9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:24.636678 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-837b3a87-949c-493a-a9a4-437fb2a663a9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:24.925042 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:25:24.927700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:25:24.927700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:25:24.927700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:25:24.927700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:25:24.936243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:24.936745 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:24.937531 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:24.937960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:24.954815 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Getting quotas for project 4c28908b00bc460781a48826aee418a7. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:25:24.959017 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Getting quotas for user 32ef923cbe984f11aacd83f6bebea57e and project 4c28908b00bc460781a48826aee418a7. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:25:24.971294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:25:24.973671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:25:25.163216 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e406f116-50bd-4454-a8a3-23807ff80940 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791942 Jun 03 13:25:25.164939 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 229/405] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:25:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 13:25:25.174263 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-cf38477d-e8eb-4602-9453-2cb9a9b2ece1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:25.174872 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-cf38477d-e8eb-4602-9453-2cb9a9b2ece1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:25.230583 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cf38477d-e8eb-4602-9453-2cb9a9b2ece1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:25.238970 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-cf38477d-e8eb-4602-9453-2cb9a9b2ece1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1214 microversion: 2.1 time: 0.068411 Jun 03 13:25:25.239554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 230/406] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:25 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:25:25.245188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4979e4f4-cfa5-4477-9e9d-e44c58bcc280 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:25.246183 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4979e4f4-cfa5-4477-9e9d-e44c58bcc280 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:25.254820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4979e4f4-cfa5-4477-9e9d-e44c58bcc280 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:25.254820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4979e4f4-cfa5-4477-9e9d-e44c58bcc280 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:25.254820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4979e4f4-cfa5-4477-9e9d-e44c58bcc280 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:25.255195 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4979e4f4-cfa5-4477-9e9d-e44c58bcc280 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:25.403167 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4979e4f4-cfa5-4477-9e9d-e44c58bcc280 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:25.411057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4979e4f4-cfa5-4477-9e9d-e44c58bcc280 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:25.412587 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4979e4f4-cfa5-4477-9e9d-e44c58bcc280 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:25.413809 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4979e4f4-cfa5-4477-9e9d-e44c58bcc280 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.173287 Jun 03 13:25:25.414654 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 231/407] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:25 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:25.720733 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-837b3a87-949c-493a-a9a4-437fb2a663a9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.109767 Jun 03 13:25:25.721351 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 177/408] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:25:24 2022] POST /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/os-volume_attachments => generated 194 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:26.256415 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6ce1f64f-5453-4ae8-b161-79d5612f3344 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:26.257050 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6ce1f64f-5453-4ae8-b161-79d5612f3344 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:26.309868 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6ce1f64f-5453-4ae8-b161-79d5612f3344 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:26.316467 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6ce1f64f-5453-4ae8-b161-79d5612f3344 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1214 microversion: 2.1 time: 0.064090 Jun 03 13:25:26.317044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 232/409] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:26 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:26.434139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a2e7307a-56c8-4c34-9471-bd1866d939fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:26.434966 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a2e7307a-56c8-4c34-9471-bd1866d939fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:26.441513 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a2e7307a-56c8-4c34-9471-bd1866d939fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:26.441997 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a2e7307a-56c8-4c34-9471-bd1866d939fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:26.442743 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a2e7307a-56c8-4c34-9471-bd1866d939fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:26.443173 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a2e7307a-56c8-4c34-9471-bd1866d939fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:26.587220 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a2e7307a-56c8-4c34-9471-bd1866d939fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:26.595283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a2e7307a-56c8-4c34-9471-bd1866d939fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:26.596820 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a2e7307a-56c8-4c34-9471-bd1866d939fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:26.598081 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a2e7307a-56c8-4c34-9471-bd1866d939fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.169015 Jun 03 13:25:26.601090 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 178/410] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:26 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:27.333945 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ddb59d81-7e6d-4033-8ece-425fcad9db00 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:27.334556 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ddb59d81-7e6d-4033-8ece-425fcad9db00 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:27.341423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ddb59d81-7e6d-4033-8ece-425fcad9db00 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:27.341867 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ddb59d81-7e6d-4033-8ece-425fcad9db00 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:27.342727 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ddb59d81-7e6d-4033-8ece-425fcad9db00 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:27.343189 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ddb59d81-7e6d-4033-8ece-425fcad9db00 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:27.408201 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ddb59d81-7e6d-4033-8ece-425fcad9db00 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:27.416352 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ddb59d81-7e6d-4033-8ece-425fcad9db00 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1266 microversion: 2.1 time: 0.086162 Jun 03 13:25:27.416996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 233/411] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:27 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:27.625578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-88b0956f-acf8-4ab3-bdc3-276170e837a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:27.625578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-88b0956f-acf8-4ab3-bdc3-276170e837a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:27.625578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=38 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:27.626396 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-88b0956f-acf8-4ab3-bdc3-276170e837a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:27.626842 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-88b0956f-acf8-4ab3-bdc3-276170e837a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:27.627634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-88b0956f-acf8-4ab3-bdc3-276170e837a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:27.628072 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-88b0956f-acf8-4ab3-bdc3-276170e837a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:27.765752 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-88b0956f-acf8-4ab3-bdc3-276170e837a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:27.774426 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-88b0956f-acf8-4ab3-bdc3-276170e837a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:27.775935 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-88b0956f-acf8-4ab3-bdc3-276170e837a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:27.777130 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-88b0956f-acf8-4ab3-bdc3-276170e837a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.163174 Jun 03 13:25:27.777681 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 179/412] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:27 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:28.435507 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-daf6689e-a8e7-4be3-992f-f63175f26ed3 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:28.436779 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-daf6689e-a8e7-4be3-992f-f63175f26ed3 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:28.453769 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-daf6689e-a8e7-4be3-992f-f63175f26ed3 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:28.453769 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-daf6689e-a8e7-4be3-992f-f63175f26ed3 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:28.453769 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-daf6689e-a8e7-4be3-992f-f63175f26ed3 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:28.453769 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-daf6689e-a8e7-4be3-992f-f63175f26ed3 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:28.514543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-daf6689e-a8e7-4be3-992f-f63175f26ed3 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:28.522017 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-daf6689e-a8e7-4be3-992f-f63175f26ed3 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1272 microversion: 2.1 time: 0.091146 Jun 03 13:25:28.531943 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 234/413] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:28 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:28.795275 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-06123b90-d075-4edf-ae72-bbfe01545ab4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:28.796727 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-06123b90-d075-4edf-ae72-bbfe01545ab4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:28.803132 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-06123b90-d075-4edf-ae72-bbfe01545ab4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:28.803579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-06123b90-d075-4edf-ae72-bbfe01545ab4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:28.804490 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-06123b90-d075-4edf-ae72-bbfe01545ab4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:28.805016 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-06123b90-d075-4edf-ae72-bbfe01545ab4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:29.038604 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-06123b90-d075-4edf-ae72-bbfe01545ab4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:29.061417 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-06123b90-d075-4edf-ae72-bbfe01545ab4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:29.062914 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-06123b90-d075-4edf-ae72-bbfe01545ab4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:29.064085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-06123b90-d075-4edf-ae72-bbfe01545ab4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.272672 Jun 03 13:25:29.065679 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 180/414] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:28 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:29.539302 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b07812bd-921a-4746-8668-dc97c25f2fe6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:29.539901 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b07812bd-921a-4746-8668-dc97c25f2fe6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:29.546504 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b07812bd-921a-4746-8668-dc97c25f2fe6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:29.546959 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b07812bd-921a-4746-8668-dc97c25f2fe6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:29.547795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b07812bd-921a-4746-8668-dc97c25f2fe6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:29.548263 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b07812bd-921a-4746-8668-dc97c25f2fe6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:29.690295 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b07812bd-921a-4746-8668-dc97c25f2fe6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:29.698825 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b07812bd-921a-4746-8668-dc97c25f2fe6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.163755 Jun 03 13:25:29.699419 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 235/415] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:29 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:30.088948 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d7a6bfab-9875-43c1-859e-008b7eb4ed4c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:30.092457 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d7a6bfab-9875-43c1-859e-008b7eb4ed4c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:30.108665 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7a6bfab-9875-43c1-859e-008b7eb4ed4c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:30.109144 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7a6bfab-9875-43c1-859e-008b7eb4ed4c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:30.109911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7a6bfab-9875-43c1-859e-008b7eb4ed4c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:30.110341 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7a6bfab-9875-43c1-859e-008b7eb4ed4c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:30.143708 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-874ddd9c-8047-4117-a2b5-478af816d802 req-c4b3d13c-f5ef-462a-977a-706280d48b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb34036-e6d5-44a5-b56d-3fcb6f6090bc", "tag": "de3ef78a-4895-428e-ae88-e92fa91d261d"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:30.151813 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-874ddd9c-8047-4117-a2b5-478af816d802 req-c4b3d13c-f5ef-462a-977a-706280d48b55 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:30.152868 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-874ddd9c-8047-4117-a2b5-478af816d802 req-c4b3d13c-f5ef-462a-977a-706280d48b55 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:30.167135 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-874ddd9c-8047-4117-a2b5-478af816d802 req-c4b3d13c-f5ef-462a-977a-706280d48b55 service nova] Creating event network-changed:de3ef78a-4895-428e-ae88-e92fa91d261d for instance eeb34036-e6d5-44a5-b56d-3fcb6f6090bc on hv-cinder-80135 Jun 03 13:25:30.172247 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-874ddd9c-8047-4117-a2b5-478af816d802 req-c4b3d13c-f5ef-462a-977a-706280d48b55 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035629 Jun 03 13:25:30.173199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 236/416] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:25:30.267038 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d7a6bfab-9875-43c1-859e-008b7eb4ed4c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:30.277320 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d7a6bfab-9875-43c1-859e-008b7eb4ed4c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:30.279270 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d7a6bfab-9875-43c1-859e-008b7eb4ed4c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:30.280496 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d7a6bfab-9875-43c1-859e-008b7eb4ed4c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.200636 Jun 03 13:25:30.281076 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 181/417] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:30 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:30.379540 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:25:30.379824 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Fri Jun 3 13:25:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:25:30.717634 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7afe5c89-3c25-42fe-a7a9-26d40401daa6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:30.718314 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7afe5c89-3c25-42fe-a7a9-26d40401daa6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:30.725008 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7afe5c89-3c25-42fe-a7a9-26d40401daa6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:30.725483 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7afe5c89-3c25-42fe-a7a9-26d40401daa6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:30.726240 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7afe5c89-3c25-42fe-a7a9-26d40401daa6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:30.727359 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7afe5c89-3c25-42fe-a7a9-26d40401daa6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:30.858418 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7afe5c89-3c25-42fe-a7a9-26d40401daa6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:30.866843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7afe5c89-3c25-42fe-a7a9-26d40401daa6 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.153288 Jun 03 13:25:30.868108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 237/418] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:30 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:31.299967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e4bc8267-b341-454d-86b6-f11f7fc9849b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:31.300637 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e4bc8267-b341-454d-86b6-f11f7fc9849b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:31.307700 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e4bc8267-b341-454d-86b6-f11f7fc9849b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:31.308165 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e4bc8267-b341-454d-86b6-f11f7fc9849b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:31.308947 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e4bc8267-b341-454d-86b6-f11f7fc9849b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:31.309385 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e4bc8267-b341-454d-86b6-f11f7fc9849b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:31.487423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e4bc8267-b341-454d-86b6-f11f7fc9849b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:31.495303 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e4bc8267-b341-454d-86b6-f11f7fc9849b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:31.497205 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e4bc8267-b341-454d-86b6-f11f7fc9849b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:31.498993 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e4bc8267-b341-454d-86b6-f11f7fc9849b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1747 microversion: 2.20 time: 0.202327 Jun 03 13:25:31.498993 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 182/419] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:31 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1747 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:31.884964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6dfaf898-38fd-40e6-bc32-9e69055a84ff tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:31.885577 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6dfaf898-38fd-40e6-bc32-9e69055a84ff tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:31.891538 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6dfaf898-38fd-40e6-bc32-9e69055a84ff tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:31.891980 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6dfaf898-38fd-40e6-bc32-9e69055a84ff tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:31.893120 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6dfaf898-38fd-40e6-bc32-9e69055a84ff tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:31.893697 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6dfaf898-38fd-40e6-bc32-9e69055a84ff tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:32.049554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6dfaf898-38fd-40e6-bc32-9e69055a84ff tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:32.056520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6dfaf898-38fd-40e6-bc32-9e69055a84ff tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.175590 Jun 03 13:25:32.057354 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 238/420] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:31 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:32.517621 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b5b7f606-42a9-402c-ac09-dbe4595d8a58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:32.518416 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b5b7f606-42a9-402c-ac09-dbe4595d8a58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:32.525709 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b5b7f606-42a9-402c-ac09-dbe4595d8a58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:32.526162 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b5b7f606-42a9-402c-ac09-dbe4595d8a58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:32.526941 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b5b7f606-42a9-402c-ac09-dbe4595d8a58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:32.527375 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b5b7f606-42a9-402c-ac09-dbe4595d8a58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:32.663436 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b5b7f606-42a9-402c-ac09-dbe4595d8a58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:32.672520 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b5b7f606-42a9-402c-ac09-dbe4595d8a58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:32.674062 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b5b7f606-42a9-402c-ac09-dbe4595d8a58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:32.675267 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b5b7f606-42a9-402c-ac09-dbe4595d8a58 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1747 microversion: 2.20 time: 0.161479 Jun 03 13:25:32.675822 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 183/421] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:32 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:33.075372 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8bedd0ca-60f2-4ded-ad13-a8f18e3ca594 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:33.076391 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8bedd0ca-60f2-4ded-ad13-a8f18e3ca594 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:33.082840 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8bedd0ca-60f2-4ded-ad13-a8f18e3ca594 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:33.083543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8bedd0ca-60f2-4ded-ad13-a8f18e3ca594 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:33.084353 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8bedd0ca-60f2-4ded-ad13-a8f18e3ca594 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:33.084795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8bedd0ca-60f2-4ded-ad13-a8f18e3ca594 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:33.231199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8bedd0ca-60f2-4ded-ad13-a8f18e3ca594 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:33.244287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8bedd0ca-60f2-4ded-ad13-a8f18e3ca594 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.174267 Jun 03 13:25:33.244873 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 239/422] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:33 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:33.361497 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-61ba9de8-bb4a-4ac2-b54d-6d85504e2635 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:33.368708 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-61ba9de8-bb4a-4ac2-b54d-6d85504e2635 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:33.369160 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-61ba9de8-bb4a-4ac2-b54d-6d85504e2635 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:33.433548 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-61ba9de8-bb4a-4ac2-b54d-6d85504e2635 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Going to try to stop instance {{(pid=118178) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 13:25:33.618616 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-61ba9de8-bb4a-4ac2-b54d-6d85504e2635 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "POST /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/action" status: 202 len: 0 microversion: 2.1 time: 0.260828 Jun 03 13:25:33.628986 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 184/423] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:25:33 2022] POST /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:25:33.629170 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2aee1753-6bac-4beb-b620-c7894eb1b3be tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:33.629397 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2aee1753-6bac-4beb-b620-c7894eb1b3be tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:33.637622 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2aee1753-6bac-4beb-b620-c7894eb1b3be tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:33.638066 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2aee1753-6bac-4beb-b620-c7894eb1b3be tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:33.638832 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2aee1753-6bac-4beb-b620-c7894eb1b3be tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:33.639261 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2aee1753-6bac-4beb-b620-c7894eb1b3be tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:33.694258 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1caadc17-9db6-47ab-96b4-b0aa670a2d73 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:33.694947 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-1caadc17-9db6-47ab-96b4-b0aa670a2d73 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:33.707676 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1caadc17-9db6-47ab-96b4-b0aa670a2d73 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:33.708121 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1caadc17-9db6-47ab-96b4-b0aa670a2d73 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:33.708912 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1caadc17-9db6-47ab-96b4-b0aa670a2d73 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:33.709370 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1caadc17-9db6-47ab-96b4-b0aa670a2d73 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:33.801795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2aee1753-6bac-4beb-b620-c7894eb1b3be tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:33.810458 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2aee1753-6bac-4beb-b620-c7894eb1b3be tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.186425 Jun 03 13:25:33.816109 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 240/424] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:33 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:33.850722 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-1caadc17-9db6-47ab-96b4-b0aa670a2d73 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:33.865001 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-1caadc17-9db6-47ab-96b4-b0aa670a2d73 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:33.868022 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-1caadc17-9db6-47ab-96b4-b0aa670a2d73 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:33.870273 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-1caadc17-9db6-47ab-96b4-b0aa670a2d73 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1747 microversion: 2.20 time: 0.179882 Jun 03 13:25:33.871113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 185/425] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:33 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1747 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:34.262000 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e7d5ddef-5c58-4545-a8b8-cebb4d99d1dd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:34.262603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e7d5ddef-5c58-4545-a8b8-cebb4d99d1dd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:34.268660 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e7d5ddef-5c58-4545-a8b8-cebb4d99d1dd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:34.269099 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e7d5ddef-5c58-4545-a8b8-cebb4d99d1dd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:34.269850 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e7d5ddef-5c58-4545-a8b8-cebb4d99d1dd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:34.270277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e7d5ddef-5c58-4545-a8b8-cebb4d99d1dd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:34.400190 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e7d5ddef-5c58-4545-a8b8-cebb4d99d1dd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:34.407847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e7d5ddef-5c58-4545-a8b8-cebb4d99d1dd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.150273 Jun 03 13:25:34.408448 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 241/426] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:34 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:34.813637 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-486bfcf5-c698-4fe2-9397-9a6535d299c1 req-c04c2f9e-78ff-4866-93b5-7f55ec5e4884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f119f5f-b6ed-45a0-a780-b1e037c96cc1", "name": "network-vif-plugged", "status": "completed", "tag": "14995843-d975-4a00-9ad9-746c61f720d5"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:34.822266 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-486bfcf5-c698-4fe2-9397-9a6535d299c1 req-c04c2f9e-78ff-4866-93b5-7f55ec5e4884 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:34.822915 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-486bfcf5-c698-4fe2-9397-9a6535d299c1 req-c04c2f9e-78ff-4866-93b5-7f55ec5e4884 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:34.828905 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-382d4902-22c5-4333-bb13-9dc15231951a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:34.829767 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-382d4902-22c5-4333-bb13-9dc15231951a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:34.834045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-486bfcf5-c698-4fe2-9397-9a6535d299c1 req-c04c2f9e-78ff-4866-93b5-7f55ec5e4884 service nova] Creating event network-vif-plugged:14995843-d975-4a00-9ad9-746c61f720d5 for instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 on hv-cinder-80135 Jun 03 13:25:34.836561 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-382d4902-22c5-4333-bb13-9dc15231951a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:34.837185 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-382d4902-22c5-4333-bb13-9dc15231951a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:34.843799 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-382d4902-22c5-4333-bb13-9dc15231951a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:34.843799 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-382d4902-22c5-4333-bb13-9dc15231951a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:34.844403 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-486bfcf5-c698-4fe2-9397-9a6535d299c1 req-c04c2f9e-78ff-4866-93b5-7f55ec5e4884 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029460 Jun 03 13:25:34.844403 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 186/427] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:34.898883 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-665a210c-eec1-42ba-83bc-fb9b376dc4b5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:34.899822 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-665a210c-eec1-42ba-83bc-fb9b376dc4b5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:34.906208 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-665a210c-eec1-42ba-83bc-fb9b376dc4b5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:34.906661 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-665a210c-eec1-42ba-83bc-fb9b376dc4b5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:34.907426 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-665a210c-eec1-42ba-83bc-fb9b376dc4b5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:34.907905 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-665a210c-eec1-42ba-83bc-fb9b376dc4b5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:34.948565 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=4 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:34.977605 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-382d4902-22c5-4333-bb13-9dc15231951a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:34.986655 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-382d4902-22c5-4333-bb13-9dc15231951a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.161507 Jun 03 13:25:34.988502 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 242/428] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:34 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:25:35.051097 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-665a210c-eec1-42ba-83bc-fb9b376dc4b5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:35.059019 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-665a210c-eec1-42ba-83bc-fb9b376dc4b5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:35.060537 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-665a210c-eec1-42ba-83bc-fb9b376dc4b5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:35.061678 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-665a210c-eec1-42ba-83bc-fb9b376dc4b5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1747 microversion: 2.20 time: 0.167655 Jun 03 13:25:35.062222 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 187/429] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:34 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1747 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:35.425839 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-89059b83-ba80-433f-9a39-df23ce88ec27 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:35.426439 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-89059b83-ba80-433f-9a39-df23ce88ec27 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:35.433430 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-89059b83-ba80-433f-9a39-df23ce88ec27 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:35.433877 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-89059b83-ba80-433f-9a39-df23ce88ec27 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:35.434621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-89059b83-ba80-433f-9a39-df23ce88ec27 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:35.435051 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-89059b83-ba80-433f-9a39-df23ce88ec27 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:35.562892 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-89059b83-ba80-433f-9a39-df23ce88ec27 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:35.571214 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-89059b83-ba80-433f-9a39-df23ce88ec27 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.148649 Jun 03 13:25:35.571855 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 243/430] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:35 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:36.003832 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-94883745-e106-4832-861e-dff6cf21347b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:36.004472 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-94883745-e106-4832-861e-dff6cf21347b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:36.011985 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94883745-e106-4832-861e-dff6cf21347b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:36.012408 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94883745-e106-4832-861e-dff6cf21347b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:36.013169 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94883745-e106-4832-861e-dff6cf21347b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:36.013610 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94883745-e106-4832-861e-dff6cf21347b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:36.031906 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:36.080710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4d058dc5-7f23-4249-9ea5-a8a73023824a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:36.081446 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4d058dc5-7f23-4249-9ea5-a8a73023824a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:36.088347 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4d058dc5-7f23-4249-9ea5-a8a73023824a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:36.088881 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4d058dc5-7f23-4249-9ea5-a8a73023824a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:36.089878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4d058dc5-7f23-4249-9ea5-a8a73023824a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:36.090389 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4d058dc5-7f23-4249-9ea5-a8a73023824a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:36.146015 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-94883745-e106-4832-861e-dff6cf21347b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:36.154818 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-94883745-e106-4832-861e-dff6cf21347b tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.154863 Jun 03 13:25:36.155532 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 188/431] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:35 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:36.219419 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4d058dc5-7f23-4249-9ea5-a8a73023824a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:36.227927 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4d058dc5-7f23-4249-9ea5-a8a73023824a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:36.229472 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4d058dc5-7f23-4249-9ea5-a8a73023824a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:36.230610 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4d058dc5-7f23-4249-9ea5-a8a73023824a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1747 microversion: 2.20 time: 0.154142 Jun 03 13:25:36.231164 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 244/432] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:36 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:36.589135 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6e2cd08d-8ab1-45ff-869b-ca2c8149eb22 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:36.589651 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6e2cd08d-8ab1-45ff-869b-ca2c8149eb22 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:36.595719 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6e2cd08d-8ab1-45ff-869b-ca2c8149eb22 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:36.596187 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6e2cd08d-8ab1-45ff-869b-ca2c8149eb22 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:36.596942 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6e2cd08d-8ab1-45ff-869b-ca2c8149eb22 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:36.597368 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6e2cd08d-8ab1-45ff-869b-ca2c8149eb22 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:36.722982 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6e2cd08d-8ab1-45ff-869b-ca2c8149eb22 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:36.730693 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6e2cd08d-8ab1-45ff-869b-ca2c8149eb22 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.146570 Jun 03 13:25:36.731250 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 189/433] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:36 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:37.170879 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-210a417d-1dc5-493f-b854-dd12f0e878d5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:37.171495 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-210a417d-1dc5-493f-b854-dd12f0e878d5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:37.173360 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=10 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:37.178080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-210a417d-1dc5-493f-b854-dd12f0e878d5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:37.178530 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-210a417d-1dc5-493f-b854-dd12f0e878d5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:37.179284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-210a417d-1dc5-493f-b854-dd12f0e878d5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:37.187243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-210a417d-1dc5-493f-b854-dd12f0e878d5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:37.249318 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-2d52d0ae-c474-42f4-af61-5e8cb8bc9a1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:37.249912 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-2d52d0ae-c474-42f4-af61-5e8cb8bc9a1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:37.256317 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2d52d0ae-c474-42f4-af61-5e8cb8bc9a1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:37.256766 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2d52d0ae-c474-42f4-af61-5e8cb8bc9a1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:37.257526 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2d52d0ae-c474-42f4-af61-5e8cb8bc9a1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:37.258591 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2d52d0ae-c474-42f4-af61-5e8cb8bc9a1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:37.314467 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-210a417d-1dc5-493f-b854-dd12f0e878d5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:37.316679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:37.325456 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-210a417d-1dc5-493f-b854-dd12f0e878d5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.158257 Jun 03 13:25:37.326248 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 245/434] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:37 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:37.397113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-2d52d0ae-c474-42f4-af61-5e8cb8bc9a1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:37.404781 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-2d52d0ae-c474-42f4-af61-5e8cb8bc9a1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:37.406283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-2d52d0ae-c474-42f4-af61-5e8cb8bc9a1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:37.407472 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-2d52d0ae-c474-42f4-af61-5e8cb8bc9a1d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1747 microversion: 2.20 time: 0.162272 Jun 03 13:25:37.408020 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 190/435] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:37 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:37.747665 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b23e2b0a-2a79-477b-b14e-8465fb5bb124 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:37.748304 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b23e2b0a-2a79-477b-b14e-8465fb5bb124 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:37.754783 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b23e2b0a-2a79-477b-b14e-8465fb5bb124 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:37.755221 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b23e2b0a-2a79-477b-b14e-8465fb5bb124 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:37.755963 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b23e2b0a-2a79-477b-b14e-8465fb5bb124 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:37.756434 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b23e2b0a-2a79-477b-b14e-8465fb5bb124 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:37.881861 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b23e2b0a-2a79-477b-b14e-8465fb5bb124 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:37.889723 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b23e2b0a-2a79-477b-b14e-8465fb5bb124 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.146195 Jun 03 13:25:37.890353 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 246/436] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:37 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:38.342576 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f483ed01-107d-4076-bded-f63b52689bb0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:38.343107 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f483ed01-107d-4076-bded-f63b52689bb0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:38.349544 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f483ed01-107d-4076-bded-f63b52689bb0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:38.349992 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f483ed01-107d-4076-bded-f63b52689bb0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:38.350747 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f483ed01-107d-4076-bded-f63b52689bb0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:38.351182 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f483ed01-107d-4076-bded-f63b52689bb0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:38.426490 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-54a91f6a-2904-409c-8633-c13f3a02dad6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:38.427235 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-54a91f6a-2904-409c-8633-c13f3a02dad6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:38.435616 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-54a91f6a-2904-409c-8633-c13f3a02dad6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:38.436308 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-54a91f6a-2904-409c-8633-c13f3a02dad6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:38.437051 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-54a91f6a-2904-409c-8633-c13f3a02dad6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:38.437611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-54a91f6a-2904-409c-8633-c13f3a02dad6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:38.497090 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f483ed01-107d-4076-bded-f63b52689bb0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:38.505242 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f483ed01-107d-4076-bded-f63b52689bb0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.166599 Jun 03 13:25:38.505900 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 191/437] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:38 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:38.573093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-54a91f6a-2904-409c-8633-c13f3a02dad6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:38.580877 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-54a91f6a-2904-409c-8633-c13f3a02dad6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:38.582372 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-54a91f6a-2904-409c-8633-c13f3a02dad6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:38.583506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-54a91f6a-2904-409c-8633-c13f3a02dad6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1747 microversion: 2.20 time: 0.161464 Jun 03 13:25:38.584059 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 247/438] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:38 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:38.907007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f2ce25a3-19d7-4836-aec3-d60faa36b5e1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:38.907739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f2ce25a3-19d7-4836-aec3-d60faa36b5e1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:38.913963 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f2ce25a3-19d7-4836-aec3-d60faa36b5e1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:38.914479 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f2ce25a3-19d7-4836-aec3-d60faa36b5e1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:38.915243 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f2ce25a3-19d7-4836-aec3-d60faa36b5e1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:38.915861 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f2ce25a3-19d7-4836-aec3-d60faa36b5e1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:39.053855 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f2ce25a3-19d7-4836-aec3-d60faa36b5e1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:39.061583 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f2ce25a3-19d7-4836-aec3-d60faa36b5e1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.158445 Jun 03 13:25:39.062141 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 192/439] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:38 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:39.522668 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3d1ca9cc-a5e9-4bf9-9e37-7091d6018370 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:39.523273 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3d1ca9cc-a5e9-4bf9-9e37-7091d6018370 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:39.529567 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3d1ca9cc-a5e9-4bf9-9e37-7091d6018370 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:39.530012 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3d1ca9cc-a5e9-4bf9-9e37-7091d6018370 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:39.530761 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3d1ca9cc-a5e9-4bf9-9e37-7091d6018370 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:39.531192 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3d1ca9cc-a5e9-4bf9-9e37-7091d6018370 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:39.602267 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e996c922-f521-40e9-a541-6e0a03c51126 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:39.603004 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e996c922-f521-40e9-a541-6e0a03c51126 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:39.611533 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e996c922-f521-40e9-a541-6e0a03c51126 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:39.612236 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e996c922-f521-40e9-a541-6e0a03c51126 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:39.613164 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e996c922-f521-40e9-a541-6e0a03c51126 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:39.613752 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e996c922-f521-40e9-a541-6e0a03c51126 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:39.658206 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3d1ca9cc-a5e9-4bf9-9e37-7091d6018370 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:39.666939 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3d1ca9cc-a5e9-4bf9-9e37-7091d6018370 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.148043 Jun 03 13:25:39.667509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 248/440] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:39 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:39.748347 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e996c922-f521-40e9-a541-6e0a03c51126 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:39.756246 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e996c922-f521-40e9-a541-6e0a03c51126 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:39.757744 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e996c922-f521-40e9-a541-6e0a03c51126 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:39.759387 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e996c922-f521-40e9-a541-6e0a03c51126 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1747 microversion: 2.20 time: 0.161550 Jun 03 13:25:39.759938 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 193/441] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:39 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:40.078824 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-cd752fe5-d339-45d4-93c7-e9b2f2e1b122 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:40.079428 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-cd752fe5-d339-45d4-93c7-e9b2f2e1b122 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:40.085337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cd752fe5-d339-45d4-93c7-e9b2f2e1b122 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:40.085777 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cd752fe5-d339-45d4-93c7-e9b2f2e1b122 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:40.086704 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cd752fe5-d339-45d4-93c7-e9b2f2e1b122 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:40.087137 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cd752fe5-d339-45d4-93c7-e9b2f2e1b122 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:40.211684 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cd752fe5-d339-45d4-93c7-e9b2f2e1b122 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:40.218943 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-cd752fe5-d339-45d4-93c7-e9b2f2e1b122 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.143919 Jun 03 13:25:40.219508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 249/442] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:40 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:40.684454 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e316c98c-d102-430f-840a-6da64fee2810 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:40.685060 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e316c98c-d102-430f-840a-6da64fee2810 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:40.691396 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e316c98c-d102-430f-840a-6da64fee2810 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:40.691838 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e316c98c-d102-430f-840a-6da64fee2810 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:40.692678 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e316c98c-d102-430f-840a-6da64fee2810 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:40.693109 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e316c98c-d102-430f-840a-6da64fee2810 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:40.776795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-76c8d61b-8614-4cd0-8069-297ee1375c41 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:40.777403 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-76c8d61b-8614-4cd0-8069-297ee1375c41 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:40.783446 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-76c8d61b-8614-4cd0-8069-297ee1375c41 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:40.783833 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-76c8d61b-8614-4cd0-8069-297ee1375c41 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:40.784646 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-76c8d61b-8614-4cd0-8069-297ee1375c41 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:40.785087 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-76c8d61b-8614-4cd0-8069-297ee1375c41 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:40.820311 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e316c98c-d102-430f-840a-6da64fee2810 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:40.829101 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e316c98c-d102-430f-840a-6da64fee2810 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.148380 Jun 03 13:25:40.829668 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 194/443] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:40 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:40.915668 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-76c8d61b-8614-4cd0-8069-297ee1375c41 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:40.923552 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-76c8d61b-8614-4cd0-8069-297ee1375c41 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:40.925091 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-76c8d61b-8614-4cd0-8069-297ee1375c41 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:40.926235 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-76c8d61b-8614-4cd0-8069-297ee1375c41 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1747 microversion: 2.20 time: 0.153369 Jun 03 13:25:40.926797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 250/444] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:40 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:41.235994 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-78a6db8d-e14f-4c35-978c-da8272241603 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:41.236686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-78a6db8d-e14f-4c35-978c-da8272241603 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:41.242720 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-78a6db8d-e14f-4c35-978c-da8272241603 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:41.245767 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-78a6db8d-e14f-4c35-978c-da8272241603 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:41.245767 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-78a6db8d-e14f-4c35-978c-da8272241603 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:41.245767 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-78a6db8d-e14f-4c35-978c-da8272241603 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:41.381072 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-78a6db8d-e14f-4c35-978c-da8272241603 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:41.388931 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-78a6db8d-e14f-4c35-978c-da8272241603 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.156707 Jun 03 13:25:41.389479 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 195/445] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:41 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:41.714098 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-480918ea-8e42-499a-b792-79e670763af3 req-687c0e18-a99b-4c42-9635-a3dabf93af7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb34036-e6d5-44a5-b56d-3fcb6f6090bc", "name": "network-vif-plugged", "status": "completed", "tag": "de3ef78a-4895-428e-ae88-e92fa91d261d"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:41.722542 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-480918ea-8e42-499a-b792-79e670763af3 req-687c0e18-a99b-4c42-9635-a3dabf93af7f service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:41.723009 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-480918ea-8e42-499a-b792-79e670763af3 req-687c0e18-a99b-4c42-9635-a3dabf93af7f service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:41.735720 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-480918ea-8e42-499a-b792-79e670763af3 req-687c0e18-a99b-4c42-9635-a3dabf93af7f service nova] Creating event network-vif-plugged:de3ef78a-4895-428e-ae88-e92fa91d261d for instance eeb34036-e6d5-44a5-b56d-3fcb6f6090bc on hv-cinder-80135 Jun 03 13:25:41.740782 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-480918ea-8e42-499a-b792-79e670763af3 req-687c0e18-a99b-4c42-9635-a3dabf93af7f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032118 Jun 03 13:25:41.741370 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 251/446] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:41.845865 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6bd75575-7c4e-467a-bc82-527d5f80c7aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:41.846399 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6bd75575-7c4e-467a-bc82-527d5f80c7aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:41.859423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6bd75575-7c4e-467a-bc82-527d5f80c7aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:41.860092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6bd75575-7c4e-467a-bc82-527d5f80c7aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:41.860930 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6bd75575-7c4e-467a-bc82-527d5f80c7aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:41.861414 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6bd75575-7c4e-467a-bc82-527d5f80c7aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:41.945582 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6f164d3d-71d5-49da-bc2e-db080f50f3f4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:41.946340 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6f164d3d-71d5-49da-bc2e-db080f50f3f4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:41.961795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6f164d3d-71d5-49da-bc2e-db080f50f3f4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:41.962365 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6f164d3d-71d5-49da-bc2e-db080f50f3f4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:41.963857 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6f164d3d-71d5-49da-bc2e-db080f50f3f4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:41.964515 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6f164d3d-71d5-49da-bc2e-db080f50f3f4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:42.058823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6bd75575-7c4e-467a-bc82-527d5f80c7aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:42.085924 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6bd75575-7c4e-467a-bc82-527d5f80c7aa tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.237682 Jun 03 13:25:42.086566 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 196/447] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:41 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:42.132737 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6f164d3d-71d5-49da-bc2e-db080f50f3f4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:42.141943 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6f164d3d-71d5-49da-bc2e-db080f50f3f4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:42.143470 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6f164d3d-71d5-49da-bc2e-db080f50f3f4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:42.144878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6f164d3d-71d5-49da-bc2e-db080f50f3f4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.203614 Jun 03 13:25:42.146780 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 252/448] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:41 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:42.406932 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6e56b32c-8476-4159-b2a8-4569c515972a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:42.407943 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6e56b32c-8476-4159-b2a8-4569c515972a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:42.414586 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6e56b32c-8476-4159-b2a8-4569c515972a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:42.415029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6e56b32c-8476-4159-b2a8-4569c515972a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:42.416646 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6e56b32c-8476-4159-b2a8-4569c515972a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:42.417018 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6e56b32c-8476-4159-b2a8-4569c515972a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:42.567905 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6e56b32c-8476-4159-b2a8-4569c515972a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:42.577622 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6e56b32c-8476-4159-b2a8-4569c515972a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.174672 Jun 03 13:25:42.588483 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 197/449] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:42 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:43.104642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d845b604-33a9-49e7-889b-4cb7ef9d8df5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:43.105280 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d845b604-33a9-49e7-889b-4cb7ef9d8df5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:43.111541 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d845b604-33a9-49e7-889b-4cb7ef9d8df5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:43.111983 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d845b604-33a9-49e7-889b-4cb7ef9d8df5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:43.112795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d845b604-33a9-49e7-889b-4cb7ef9d8df5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:43.113226 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d845b604-33a9-49e7-889b-4cb7ef9d8df5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:43.170953 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6a9f6ad8-6e57-4c2c-821c-e3a04780633e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:43.171871 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6a9f6ad8-6e57-4c2c-821c-e3a04780633e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:43.179374 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6a9f6ad8-6e57-4c2c-821c-e3a04780633e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:43.179897 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6a9f6ad8-6e57-4c2c-821c-e3a04780633e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:43.180619 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6a9f6ad8-6e57-4c2c-821c-e3a04780633e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:43.181111 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6a9f6ad8-6e57-4c2c-821c-e3a04780633e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:43.328534 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d845b604-33a9-49e7-889b-4cb7ef9d8df5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:43.339122 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d845b604-33a9-49e7-889b-4cb7ef9d8df5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.239235 Jun 03 13:25:43.339471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6a9f6ad8-6e57-4c2c-821c-e3a04780633e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:43.340519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 253/450] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:43 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:43.357831 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6a9f6ad8-6e57-4c2c-821c-e3a04780633e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:43.359354 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6a9f6ad8-6e57-4c2c-821c-e3a04780633e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:43.360526 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6a9f6ad8-6e57-4c2c-821c-e3a04780633e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.194561 Jun 03 13:25:43.361339 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 198/451] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:43 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:43.594683 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8a1e723c-d7b3-4f13-b227-66b4c7bee7b1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:43.595635 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8a1e723c-d7b3-4f13-b227-66b4c7bee7b1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:43.601612 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8a1e723c-d7b3-4f13-b227-66b4c7bee7b1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:43.602064 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8a1e723c-d7b3-4f13-b227-66b4c7bee7b1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:43.602823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8a1e723c-d7b3-4f13-b227-66b4c7bee7b1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:43.603319 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8a1e723c-d7b3-4f13-b227-66b4c7bee7b1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:43.747035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8a1e723c-d7b3-4f13-b227-66b4c7bee7b1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:43.754998 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8a1e723c-d7b3-4f13-b227-66b4c7bee7b1 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.164068 Jun 03 13:25:43.755711 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 254/452] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:43 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:44.356557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-02d1d6f6-0346-4c96-985e-571f0f24fff4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:44.357185 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-02d1d6f6-0346-4c96-985e-571f0f24fff4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:44.364233 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-02d1d6f6-0346-4c96-985e-571f0f24fff4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:44.364675 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-02d1d6f6-0346-4c96-985e-571f0f24fff4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:44.365425 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-02d1d6f6-0346-4c96-985e-571f0f24fff4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:44.365851 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-02d1d6f6-0346-4c96-985e-571f0f24fff4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:44.380021 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-57748dd7-0e93-4bd2-99b4-cd2b406a3ad7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:44.380654 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-57748dd7-0e93-4bd2-99b4-cd2b406a3ad7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:44.387601 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-57748dd7-0e93-4bd2-99b4-cd2b406a3ad7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:44.388330 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-57748dd7-0e93-4bd2-99b4-cd2b406a3ad7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:44.389267 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-57748dd7-0e93-4bd2-99b4-cd2b406a3ad7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:44.389880 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-57748dd7-0e93-4bd2-99b4-cd2b406a3ad7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:44.544726 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-57748dd7-0e93-4bd2-99b4-cd2b406a3ad7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:44.556249 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-57748dd7-0e93-4bd2-99b4-cd2b406a3ad7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:44.559083 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-57748dd7-0e93-4bd2-99b4-cd2b406a3ad7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:44.560500 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-57748dd7-0e93-4bd2-99b4-cd2b406a3ad7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.184266 Jun 03 13:25:44.561407 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 255/453] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:44 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:44.770696 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-de1aa3c8-007e-411c-a5bf-dee9e0a05949 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:44.771587 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-de1aa3c8-007e-411c-a5bf-dee9e0a05949 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:44.778944 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-de1aa3c8-007e-411c-a5bf-dee9e0a05949 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:44.784187 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-de1aa3c8-007e-411c-a5bf-dee9e0a05949 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:44.784187 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-de1aa3c8-007e-411c-a5bf-dee9e0a05949 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:44.784187 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-de1aa3c8-007e-411c-a5bf-dee9e0a05949 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:44.802666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-02d1d6f6-0346-4c96-985e-571f0f24fff4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:44.815191 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-02d1d6f6-0346-4c96-985e-571f0f24fff4 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.462648 Jun 03 13:25:44.828345 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 199/454] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:44 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:44.942131 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-de1aa3c8-007e-411c-a5bf-dee9e0a05949 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:44.949973 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-de1aa3c8-007e-411c-a5bf-dee9e0a05949 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.183187 Jun 03 13:25:44.950577 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 256/455] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:44 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:25:45.580794 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-722e94f2-4fb8-4aa8-9577-4aec9983a412 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:45.583189 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-722e94f2-4fb8-4aa8-9577-4aec9983a412 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:45.589459 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-722e94f2-4fb8-4aa8-9577-4aec9983a412 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:45.590201 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-722e94f2-4fb8-4aa8-9577-4aec9983a412 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:45.591024 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-722e94f2-4fb8-4aa8-9577-4aec9983a412 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:45.591640 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-722e94f2-4fb8-4aa8-9577-4aec9983a412 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:45.733092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-722e94f2-4fb8-4aa8-9577-4aec9983a412 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:45.739485 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7d5a7fb2-0855-424d-95ab-adbcea68fd03 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:45.741262 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7d5a7fb2-0855-424d-95ab-adbcea68fd03 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:45.742927 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-722e94f2-4fb8-4aa8-9577-4aec9983a412 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:45.745257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-722e94f2-4fb8-4aa8-9577-4aec9983a412 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:45.746882 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-722e94f2-4fb8-4aa8-9577-4aec9983a412 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.171408 Jun 03 13:25:45.748940 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7d5a7fb2-0855-424d-95ab-adbcea68fd03 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:45.749610 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7d5a7fb2-0855-424d-95ab-adbcea68fd03 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:45.750544 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7d5a7fb2-0855-424d-95ab-adbcea68fd03 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:45.751328 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7d5a7fb2-0855-424d-95ab-adbcea68fd03 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:45.759993 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 200/456] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:45 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:45.833690 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-80d33b92-505e-4c94-8c57-c29dd44e30ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:45.834008 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-80d33b92-505e-4c94-8c57-c29dd44e30ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:45.841712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-80d33b92-505e-4c94-8c57-c29dd44e30ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:45.842517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-80d33b92-505e-4c94-8c57-c29dd44e30ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:45.844070 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-80d33b92-505e-4c94-8c57-c29dd44e30ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:45.845378 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-80d33b92-505e-4c94-8c57-c29dd44e30ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:45.899723 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7d5a7fb2-0855-424d-95ab-adbcea68fd03 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:45.908299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7d5a7fb2-0855-424d-95ab-adbcea68fd03 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1594 microversion: 2.1 time: 0.173023 Jun 03 13:25:45.909409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 257/457] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:45 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1594 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:25:45.967454 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8e49edba-0527-48f6-a72b-6d55e4705d83 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:45.968206 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8e49edba-0527-48f6-a72b-6d55e4705d83 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:45.978829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8e49edba-0527-48f6-a72b-6d55e4705d83 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:45.978829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8e49edba-0527-48f6-a72b-6d55e4705d83 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:45.978829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8e49edba-0527-48f6-a72b-6d55e4705d83 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:45.979159 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8e49edba-0527-48f6-a72b-6d55e4705d83 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:46.051444 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-80d33b92-505e-4c94-8c57-c29dd44e30ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:46.060748 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-80d33b92-505e-4c94-8c57-c29dd44e30ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.231196 Jun 03 13:25:46.061325 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 201/458] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:45 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:25:46.183936 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8e49edba-0527-48f6-a72b-6d55e4705d83 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:46.199592 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8e49edba-0527-48f6-a72b-6d55e4705d83 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1314 microversion: 2.1 time: 0.228672 Jun 03 13:25:46.200045 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 258/459] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:45 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:46.771649 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c7339e04-d55b-4b2c-940f-1f4037615a15 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:46.774545 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-c7339e04-d55b-4b2c-940f-1f4037615a15 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:46.783942 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c7339e04-d55b-4b2c-940f-1f4037615a15 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:46.783942 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c7339e04-d55b-4b2c-940f-1f4037615a15 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:46.784980 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c7339e04-d55b-4b2c-940f-1f4037615a15 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:46.785612 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c7339e04-d55b-4b2c-940f-1f4037615a15 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:46.971967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c7339e04-d55b-4b2c-940f-1f4037615a15 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:46.971967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c7339e04-d55b-4b2c-940f-1f4037615a15 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:46.972425 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c7339e04-d55b-4b2c-940f-1f4037615a15 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:46.972425 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c7339e04-d55b-4b2c-940f-1f4037615a15 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.205277 Jun 03 13:25:46.972425 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 202/460] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:46 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:47.077733 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-088882bd-70fe-4a20-9e0d-8abaaed826ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:47.078339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-088882bd-70fe-4a20-9e0d-8abaaed826ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:47.084639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-088882bd-70fe-4a20-9e0d-8abaaed826ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:47.085087 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-088882bd-70fe-4a20-9e0d-8abaaed826ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:47.085852 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-088882bd-70fe-4a20-9e0d-8abaaed826ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:47.086290 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-088882bd-70fe-4a20-9e0d-8abaaed826ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:47.209526 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-cdf8545b-038e-4184-9956-8279ef6f11cd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:47.210045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-cdf8545b-038e-4184-9956-8279ef6f11cd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:47.216686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cdf8545b-038e-4184-9956-8279ef6f11cd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:47.217167 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cdf8545b-038e-4184-9956-8279ef6f11cd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:47.217961 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cdf8545b-038e-4184-9956-8279ef6f11cd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:47.218371 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cdf8545b-038e-4184-9956-8279ef6f11cd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:47.361358 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-cdf8545b-038e-4184-9956-8279ef6f11cd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:47.369268 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-cdf8545b-038e-4184-9956-8279ef6f11cd tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1464 microversion: 2.1 time: 0.163795 Jun 03 13:25:47.370028 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 203/461] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:47 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:47.371991 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-088882bd-70fe-4a20-9e0d-8abaaed826ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:47.380696 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-088882bd-70fe-4a20-9e0d-8abaaed826ee tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.306813 Jun 03 13:25:47.381261 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 259/462] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:47 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:47.411401 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dbe72464-88df-4b32-ae15-81538535b267 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:47.411896 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dbe72464-88df-4b32-ae15-81538535b267 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:47.418753 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dbe72464-88df-4b32-ae15-81538535b267 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:47.424012 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dbe72464-88df-4b32-ae15-81538535b267 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:47.424012 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dbe72464-88df-4b32-ae15-81538535b267 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:47.424012 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dbe72464-88df-4b32-ae15-81538535b267 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:47.448900 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dbe72464-88df-4b32-ae15-81538535b267 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Going to try to terminate instance {{(pid=118178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:25:47.474030 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=100 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:47.803955 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dbe72464-88df-4b32-ae15-81538535b267 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "DELETE /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 204 len: 0 microversion: 2.1 time: 0.396085 Jun 03 13:25:47.804927 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 204/463] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:25:47 2022] DELETE /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:25:47.813536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7b2e68f2-bd39-42ba-b8f5-b62edaf1e41e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:47.814153 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7b2e68f2-bd39-42ba-b8f5-b62edaf1e41e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:47.820913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7b2e68f2-bd39-42ba-b8f5-b62edaf1e41e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:47.821358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7b2e68f2-bd39-42ba-b8f5-b62edaf1e41e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:47.822224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7b2e68f2-bd39-42ba-b8f5-b62edaf1e41e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:47.822795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7b2e68f2-bd39-42ba-b8f5-b62edaf1e41e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:47.991071 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f06cd8ce-c0fc-4f18-8bb0-e8122135d7ed tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:47.992209 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f06cd8ce-c0fc-4f18-8bb0-e8122135d7ed tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:48.006640 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f06cd8ce-c0fc-4f18-8bb0-e8122135d7ed tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:48.007560 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f06cd8ce-c0fc-4f18-8bb0-e8122135d7ed tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:48.008595 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f06cd8ce-c0fc-4f18-8bb0-e8122135d7ed tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:48.010194 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f06cd8ce-c0fc-4f18-8bb0-e8122135d7ed tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:48.049414 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7b2e68f2-bd39-42ba-b8f5-b62edaf1e41e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:48.065352 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7b2e68f2-bd39-42ba-b8f5-b62edaf1e41e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1470 microversion: 2.1 time: 0.255487 Jun 03 13:25:48.077101 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 260/464] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:47 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1470 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:25:48.259418 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f06cd8ce-c0fc-4f18-8bb0-e8122135d7ed tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:48.268123 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f06cd8ce-c0fc-4f18-8bb0-e8122135d7ed tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:48.269618 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f06cd8ce-c0fc-4f18-8bb0-e8122135d7ed tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:48.271273 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f06cd8ce-c0fc-4f18-8bb0-e8122135d7ed tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.287689 Jun 03 13:25:48.282785 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 205/465] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:47 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:48.400201 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-75b08ffc-fc89-4c65-87d8-c6499cff9d92 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:48.401060 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-75b08ffc-fc89-4c65-87d8-c6499cff9d92 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:48.408175 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-75b08ffc-fc89-4c65-87d8-c6499cff9d92 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:48.408702 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-75b08ffc-fc89-4c65-87d8-c6499cff9d92 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:48.409722 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-75b08ffc-fc89-4c65-87d8-c6499cff9d92 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:48.410220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-75b08ffc-fc89-4c65-87d8-c6499cff9d92 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:48.618480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-75b08ffc-fc89-4c65-87d8-c6499cff9d92 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:48.626681 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-75b08ffc-fc89-4c65-87d8-c6499cff9d92 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.232122 Jun 03 13:25:48.627613 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 261/466] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:48 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:48.993354 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-72b88605-a27a-41e8-8676-c467419a96f2 req-0a851c0c-38b4-441f-9d93-b6299a4c1e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfaaead1-3faf-4b34-a756-3d1cc7e7d19d", "tag": "6643f089-18b4-4d4c-8781-ba618ecca2fe"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:49.016066 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-72b88605-a27a-41e8-8676-c467419a96f2 req-0a851c0c-38b4-441f-9d93-b6299a4c1e95 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:49.021224 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-72b88605-a27a-41e8-8676-c467419a96f2 req-0a851c0c-38b4-441f-9d93-b6299a4c1e95 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:49.038266 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-72b88605-a27a-41e8-8676-c467419a96f2 req-0a851c0c-38b4-441f-9d93-b6299a4c1e95 service nova] Creating event network-changed:6643f089-18b4-4d4c-8781-ba618ecca2fe for instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d on hv-cinder-80135 Jun 03 13:25:49.046292 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-72b88605-a27a-41e8-8676-c467419a96f2 req-0a851c0c-38b4-441f-9d93-b6299a4c1e95 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056455 Jun 03 13:25:49.053450 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 206/467] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:49.094330 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4bb56544-8734-458f-8e37-4b880f053c55 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:49.095042 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4bb56544-8734-458f-8e37-4b880f053c55 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:49.101646 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4bb56544-8734-458f-8e37-4b880f053c55 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:49.102547 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4bb56544-8734-458f-8e37-4b880f053c55 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:49.103983 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4bb56544-8734-458f-8e37-4b880f053c55 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:49.104693 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4bb56544-8734-458f-8e37-4b880f053c55 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:49.290313 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7865e6d3-477f-4f8e-9baa-20b0694ff3aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:49.292135 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-7865e6d3-477f-4f8e-9baa-20b0694ff3aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:49.308442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7865e6d3-477f-4f8e-9baa-20b0694ff3aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:49.309386 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7865e6d3-477f-4f8e-9baa-20b0694ff3aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:49.310383 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7865e6d3-477f-4f8e-9baa-20b0694ff3aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:49.312694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7865e6d3-477f-4f8e-9baa-20b0694ff3aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:49.398441 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4bb56544-8734-458f-8e37-4b880f053c55 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:49.410606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4bb56544-8734-458f-8e37-4b880f053c55 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1470 microversion: 2.1 time: 0.320335 Jun 03 13:25:49.416484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 262/468] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:49 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1470 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:49.646982 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-72212b26-f94d-4608-8729-d1e84b6cc7e9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:49.647803 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-72212b26-f94d-4608-8729-d1e84b6cc7e9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:49.656461 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-72212b26-f94d-4608-8729-d1e84b6cc7e9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:49.657310 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-72212b26-f94d-4608-8729-d1e84b6cc7e9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:49.658519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-72212b26-f94d-4608-8729-d1e84b6cc7e9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:49.659246 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-72212b26-f94d-4608-8729-d1e84b6cc7e9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:49.663554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:49.847087 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-7865e6d3-477f-4f8e-9baa-20b0694ff3aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:49.883446 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-7865e6d3-477f-4f8e-9baa-20b0694ff3aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:49.893631 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-7865e6d3-477f-4f8e-9baa-20b0694ff3aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:49.895380 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-7865e6d3-477f-4f8e-9baa-20b0694ff3aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.609256 Jun 03 13:25:49.912345 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 207/469] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:49 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:49.944995 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-72212b26-f94d-4608-8729-d1e84b6cc7e9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:49.960695 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-72212b26-f94d-4608-8729-d1e84b6cc7e9 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.318071 Jun 03 13:25:49.961819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 263/470] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:49 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:25:50.430001 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-cb6574b0-bde8-4182-855a-41806cd4a04e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:50.432548 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-cb6574b0-bde8-4182-855a-41806cd4a04e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:50.445349 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cb6574b0-bde8-4182-855a-41806cd4a04e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:50.447876 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cb6574b0-bde8-4182-855a-41806cd4a04e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:50.452428 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cb6574b0-bde8-4182-855a-41806cd4a04e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:50.453144 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cb6574b0-bde8-4182-855a-41806cd4a04e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:50.812782 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-cb6574b0-bde8-4182-855a-41806cd4a04e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:50.839159 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-cb6574b0-bde8-4182-855a-41806cd4a04e tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1470 microversion: 2.1 time: 0.413063 Jun 03 13:25:50.846133 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 208/471] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:50 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1470 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:50.922858 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a9438def-ea8e-4c9a-b0aa-458e0532cc60 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:50.926964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a9438def-ea8e-4c9a-b0aa-458e0532cc60 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:50.937358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a9438def-ea8e-4c9a-b0aa-458e0532cc60 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:50.938694 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a9438def-ea8e-4c9a-b0aa-458e0532cc60 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:50.939862 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a9438def-ea8e-4c9a-b0aa-458e0532cc60 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:50.940950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a9438def-ea8e-4c9a-b0aa-458e0532cc60 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:50.979160 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a7fa4637-151d-43b9-b929-eff5f2096743 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:50.979874 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a7fa4637-151d-43b9-b929-eff5f2096743 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:50.988685 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a7fa4637-151d-43b9-b929-eff5f2096743 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:50.991348 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a7fa4637-151d-43b9-b929-eff5f2096743 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:50.995574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a7fa4637-151d-43b9-b929-eff5f2096743 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:50.995574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a7fa4637-151d-43b9-b929-eff5f2096743 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:51.294002 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a9438def-ea8e-4c9a-b0aa-458e0532cc60 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:51.297679 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a7fa4637-151d-43b9-b929-eff5f2096743 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:51.308059 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a7fa4637-151d-43b9-b929-eff5f2096743 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.331628 Jun 03 13:25:51.309387 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 209/472] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:50 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:51.314583 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-dd78d5ec-8e3e-43a5-b49f-31fe2db3448b req-f2b244ac-a741-4b46-99d9-cf254cd44064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb34036-e6d5-44a5-b56d-3fcb6f6090bc", "name": "network-vif-deleted", "tag": "de3ef78a-4895-428e-ae88-e92fa91d261d"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:51.327269 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-dd78d5ec-8e3e-43a5-b49f-31fe2db3448b req-f2b244ac-a741-4b46-99d9-cf254cd44064 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:51.327974 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-dd78d5ec-8e3e-43a5-b49f-31fe2db3448b req-f2b244ac-a741-4b46-99d9-cf254cd44064 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:51.333632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a9438def-ea8e-4c9a-b0aa-458e0532cc60 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:51.344130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a9438def-ea8e-4c9a-b0aa-458e0532cc60 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:51.351859 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-dd78d5ec-8e3e-43a5-b49f-31fe2db3448b req-f2b244ac-a741-4b46-99d9-cf254cd44064 service nova] Creating event network-vif-deleted:de3ef78a-4895-428e-ae88-e92fa91d261d for instance eeb34036-e6d5-44a5-b56d-3fcb6f6090bc on hv-cinder-80135 Jun 03 13:25:51.359329 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-dd78d5ec-8e3e-43a5-b49f-31fe2db3448b req-f2b244ac-a741-4b46-99d9-cf254cd44064 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047198 Jun 03 13:25:51.362367 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a9438def-ea8e-4c9a-b0aa-458e0532cc60 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.449198 Jun 03 13:25:51.362980 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 264/473] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:50 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:51.364792 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 210/474] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:51.857306 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-bac0176d-bfa2-40b5-a551-bc13e9862725 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:51.857832 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-bac0176d-bfa2-40b5-a551-bc13e9862725 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:51.859693 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:51.864653 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bac0176d-bfa2-40b5-a551-bc13e9862725 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:51.865102 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bac0176d-bfa2-40b5-a551-bc13e9862725 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:51.865858 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bac0176d-bfa2-40b5-a551-bc13e9862725 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:51.866305 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bac0176d-bfa2-40b5-a551-bc13e9862725 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:51.899080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bac0176d-bfa2-40b5-a551-bc13e9862725 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:51.899524 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bac0176d-bfa2-40b5-a551-bc13e9862725 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:51.899972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-bac0176d-bfa2-40b5-a551-bc13e9862725 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lazy-loading 'fault' on Instance uuid eeb34036-e6d5-44a5-b56d-3fcb6f6090bc {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:25:51.945686 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-bac0176d-bfa2-40b5-a551-bc13e9862725 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:51.955109 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-bac0176d-bfa2-40b5-a551-bc13e9862725 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1304 microversion: 2.1 time: 0.101863 Jun 03 13:25:51.955670 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 265/475] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:51 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:52.328079 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-2d988a67-630f-4d92-a96c-de77a2876c15 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:52.334666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-2d988a67-630f-4d92-a96c-de77a2876c15 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:52.337120 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2d988a67-630f-4d92-a96c-de77a2876c15 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:52.340484 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2d988a67-630f-4d92-a96c-de77a2876c15 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:52.341447 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2d988a67-630f-4d92-a96c-de77a2876c15 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:52.341963 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2d988a67-630f-4d92-a96c-de77a2876c15 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:52.380637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-91654487-a101-49c2-8210-597ff964d64c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:52.381348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-91654487-a101-49c2-8210-597ff964d64c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:52.388495 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-91654487-a101-49c2-8210-597ff964d64c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:52.392540 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-91654487-a101-49c2-8210-597ff964d64c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:52.404764 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-91654487-a101-49c2-8210-597ff964d64c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:52.405461 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-91654487-a101-49c2-8210-597ff964d64c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:52.653768 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-2d988a67-630f-4d92-a96c-de77a2876c15 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:52.657115 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-91654487-a101-49c2-8210-597ff964d64c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:52.666921 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-2d988a67-630f-4d92-a96c-de77a2876c15 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1723 microversion: 2.1 time: 0.344496 Jun 03 13:25:52.668621 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 211/476] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:52 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:52.673728 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-91654487-a101-49c2-8210-597ff964d64c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:52.678418 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-91654487-a101-49c2-8210-597ff964d64c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:52.683100 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-91654487-a101-49c2-8210-597ff964d64c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.304483 Jun 03 13:25:52.684084 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 266/477] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:52 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:25:52.973405 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dfc7401b-9ada-479d-aa41-264981375628 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:52.974283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dfc7401b-9ada-479d-aa41-264981375628 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:52.981581 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfc7401b-9ada-479d-aa41-264981375628 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:52.982346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfc7401b-9ada-479d-aa41-264981375628 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:52.983304 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfc7401b-9ada-479d-aa41-264981375628 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:52.983733 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfc7401b-9ada-479d-aa41-264981375628 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:53.019217 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfc7401b-9ada-479d-aa41-264981375628 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:53.019960 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfc7401b-9ada-479d-aa41-264981375628 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:53.020604 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-dfc7401b-9ada-479d-aa41-264981375628 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lazy-loading 'fault' on Instance uuid eeb34036-e6d5-44a5-b56d-3fcb6f6090bc {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:25:53.063420 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-dfc7401b-9ada-479d-aa41-264981375628 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef923cbe984f11aacd83f6bebea57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28908b00bc460781a48826aee418a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:53.071540 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dfc7401b-9ada-479d-aa41-264981375628 tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 200 len: 1304 microversion: 2.1 time: 0.103126 Jun 03 13:25:53.078676 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 212/478] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:52 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:25:53.279336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c7476949-9784-47b8-9a44-c9b70cefb4f7 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-724337416"}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:53.280909 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c7476949-9784-47b8-9a44-c9b70cefb4f7 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:53.289673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c7476949-9784-47b8-9a44-c9b70cefb4f7 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:53.290320 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c7476949-9784-47b8-9a44-c9b70cefb4f7 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:53.291404 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c7476949-9784-47b8-9a44-c9b70cefb4f7 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:53.291994 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c7476949-9784-47b8-9a44-c9b70cefb4f7 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:53.495048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.network.security_group_api [None req-c7476949-9784-47b8-9a44-c9b70cefb4f7 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Adding security group 743329e8-004b-493e-a3b8-61982c0ca6dd to port 6643f089-18b4-4d4c-8781-ba618ecca2fe Jun 03 13:25:53.686036 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6d08c37b-4aa0-47bd-b223-6d229ae8f887 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:53.686665 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6d08c37b-4aa0-47bd-b223-6d229ae8f887 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:53.693679 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6d08c37b-4aa0-47bd-b223-6d229ae8f887 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:53.694377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6d08c37b-4aa0-47bd-b223-6d229ae8f887 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:53.695472 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6d08c37b-4aa0-47bd-b223-6d229ae8f887 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:53.696114 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6d08c37b-4aa0-47bd-b223-6d229ae8f887 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:53.855412 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6d08c37b-4aa0-47bd-b223-6d229ae8f887 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:53.864435 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6d08c37b-4aa0-47bd-b223-6d229ae8f887 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1700 microversion: 2.1 time: 0.183231 Jun 03 13:25:53.878805 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 213/479] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:53 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1700 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:25:53.884486 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-63e83b4b-89db-4c1d-9514-3f45299a6075 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:53.885714 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-63e83b4b-89db-4c1d-9514-3f45299a6075 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:53.893356 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-63e83b4b-89db-4c1d-9514-3f45299a6075 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:53.897193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-63e83b4b-89db-4c1d-9514-3f45299a6075 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:53.897193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-63e83b4b-89db-4c1d-9514-3f45299a6075 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:53.897193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-63e83b4b-89db-4c1d-9514-3f45299a6075 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:54.063597 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-63e83b4b-89db-4c1d-9514-3f45299a6075 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:54.076374 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-63e83b4b-89db-4c1d-9514-3f45299a6075 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:54.107221 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-63e83b4b-89db-4c1d-9514-3f45299a6075 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:54.107221 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-63e83b4b-89db-4c1d-9514-3f45299a6075 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.212173 Jun 03 13:25:54.107221 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 214/480] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:53 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:54.111241 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c7476949-9784-47b8-9a44-c9b70cefb4f7 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "POST /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/action" status: 202 len: 0 microversion: 2.1 time: 0.839675 Jun 03 13:25:54.112578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-85259a50-b468-45cb-b818-00fffca294e0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:54.113023 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 267/481] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:25:53 2022] POST /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/action => generated 0 bytes in 842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:25:54.118539 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-fb6bf5b4-afd1-4d9f-8269-c1a94caed96a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:54.119559 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-fb6bf5b4-afd1-4d9f-8269-c1a94caed96a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] [instance: eeb34036-e6d5-44a5-b56d-3fcb6f6090bc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:54.132752 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-85259a50-b468-45cb-b818-00fffca294e0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:54.133219 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fb6bf5b4-afd1-4d9f-8269-c1a94caed96a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:54.133219 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fb6bf5b4-afd1-4d9f-8269-c1a94caed96a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:54.134210 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fb6bf5b4-afd1-4d9f-8269-c1a94caed96a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:54.134614 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-85259a50-b468-45cb-b818-00fffca294e0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:54.135169 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fb6bf5b4-afd1-4d9f-8269-c1a94caed96a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:54.156564 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-fb6bf5b4-afd1-4d9f-8269-c1a94caed96a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] HTTP exception thrown: Instance eeb34036-e6d5-44a5-b56d-3fcb6f6090bc could not be found. Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-fb6bf5b4-afd1-4d9f-8269-c1a94caed96a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Request method failure captured: Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc HTTP/1.1 Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgvAgtOzMA0UqHlZyiIOemJTD3ri0R-xVK7Qj4ZhYcZxywM1XcIZMR2eSONUVSASuTY-vR__CmiqpDOrS1AcYi3h4QxV03sJ3QdoQFezre2giyMEZrUE814PZPYQej0sjQqal9Y1Q_zXCtAB0cYP8Rtjz1bRih5eCfdUOE8bZpU_55g Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 4c28908b00bc460781a48826aee418a7 Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesNegativeTest-1409089 Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:25:54.158611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:25:54.159931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4c28908b00bc460781a48826aee418a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c28908b00bc460781a48826aee418a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4c28908b00bc460781a48826aee418a7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c28908b00bc460781a48826aee418a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:25:54.159931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesNegativeTest-1409089 Jun 03 13:25:54.159931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 4c28908b00bc460781a48826aee418a7 Jun 03 13:25:54.159931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesNegativeTest-1409089 Jun 03 13:25:54.159931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesNegativeTest-1409089-project Jun 03 13:25:54.159931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:25:54.159931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:25:54.159931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 32ef923cbe984f11aacd83f6bebea57e Jun 03 13:25:54.159931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesNegativeTest-1409089-project Jun 03 13:25:54.159931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:25:54.159931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance eeb34036-e6d5-44a5-b56d-3fcb6f6090bc could not be found. Jun 03 13:25:54.159931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': 'eeb34036-e6d5-44a5-b56d-3fcb6f6090bc'} Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb34036-e6d5-44a5-b56d-3fcb6f6090bc could not be found. Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:25:54.160738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb34036-e6d5-44a5-b56d-3fcb6f6090bc could not be found. Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb34036-e6d5-44a5-b56d-3fcb6f6090bc could not be found. Jun 03 13:25:54.161968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:25:54.167455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-fb6bf5b4-afd1-4d9f-8269-c1a94caed96a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] Returning 404 to user: Instance eeb34036-e6d5-44a5-b56d-3fcb6f6090bc could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:25:54.171294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-fb6bf5b4-afd1-4d9f-8269-c1a94caed96a tempest-VolumesNegativeTest-1409089 tempest-VolumesNegativeTest-1409089-project] 10.222.0.61 "GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc" status: 404 len: 111 microversion: 2.1 time: 0.054515 Jun 03 13:25:54.171294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 268/482] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:54 2022] GET /compute/v2.1/servers/eeb34036-e6d5-44a5-b56d-3fcb6f6090bc => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:25:54.197096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-718b7f85-f286-4056-b1ad-2d72fae87703 req-8ac1d2f5-4b7e-40ba-a7e1-87a4f09a31f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfaaead1-3faf-4b34-a756-3d1cc7e7d19d", "tag": "6643f089-18b4-4d4c-8781-ba618ecca2fe"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:54.201262 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-85259a50-b468-45cb-b818-00fffca294e0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Going to try to start instance {{(pid=118178) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 13:25:54.213660 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-718b7f85-f286-4056-b1ad-2d72fae87703 req-8ac1d2f5-4b7e-40ba-a7e1-87a4f09a31f6 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:54.214682 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-718b7f85-f286-4056-b1ad-2d72fae87703 req-8ac1d2f5-4b7e-40ba-a7e1-87a4f09a31f6 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:54.237695 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-718b7f85-f286-4056-b1ad-2d72fae87703 req-8ac1d2f5-4b7e-40ba-a7e1-87a4f09a31f6 service nova] Creating event network-changed:6643f089-18b4-4d4c-8781-ba618ecca2fe for instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d on hv-cinder-80135 Jun 03 13:25:54.245076 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-718b7f85-f286-4056-b1ad-2d72fae87703 req-8ac1d2f5-4b7e-40ba-a7e1-87a4f09a31f6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050662 Jun 03 13:25:54.247191 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 269/483] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:54.253932 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0fb61396-d244-4f4f-aa2b-7a5026409ef8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:54.256490 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0fb61396-d244-4f4f-aa2b-7a5026409ef8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:54.264411 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0fb61396-d244-4f4f-aa2b-7a5026409ef8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:54.265226 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0fb61396-d244-4f4f-aa2b-7a5026409ef8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:54.266585 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0fb61396-d244-4f4f-aa2b-7a5026409ef8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:54.267204 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0fb61396-d244-4f4f-aa2b-7a5026409ef8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:54.470051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-85259a50-b468-45cb-b818-00fffca294e0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "POST /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/action" status: 202 len: 0 microversion: 2.1 time: 0.371725 Jun 03 13:25:54.472785 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 215/484] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:25:54 2022] POST /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:25:54.486353 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f5e6689e-ac7f-472a-8fd1-87c108c3c510 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:54.487169 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f5e6689e-ac7f-472a-8fd1-87c108c3c510 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:54.502617 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f5e6689e-ac7f-472a-8fd1-87c108c3c510 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:54.506229 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f5e6689e-ac7f-472a-8fd1-87c108c3c510 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:54.507402 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f5e6689e-ac7f-472a-8fd1-87c108c3c510 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:54.507988 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f5e6689e-ac7f-472a-8fd1-87c108c3c510 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:54.642282 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0fb61396-d244-4f4f-aa2b-7a5026409ef8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:54.663302 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0fb61396-d244-4f4f-aa2b-7a5026409ef8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1759 microversion: 2.1 time: 0.414666 Jun 03 13:25:54.665190 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 270/485] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:54 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1759 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:54.851125 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f5e6689e-ac7f-472a-8fd1-87c108c3c510 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:54.860093 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f5e6689e-ac7f-472a-8fd1-87c108c3c510 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1709 microversion: 2.1 time: 0.378313 Jun 03 13:25:54.875704 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 216/486] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:54 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1709 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:54.878004 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-af481255-c25d-404e-9e58-e53327c43b67 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: .version_select at 0x7f5bc8b90dc0>, body: {"keypair": {"name": "tempest-keypair-311302372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8Jx6aI6OgqmGbAyb4RGQzooohaioQHpFz1i3v2hW8RO5Vuo2i0Lx00on1Tx3XoUlVUGxDg+payFbsDY/TSaJDfoIBGdg49thkkTYPC9E2TylDQqi0H236GrPsWK1rE7w=="}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:54.920344 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-af481255-c25d-404e-9e58-e53327c43b67 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'key_pairs'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:25:54.932120 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-af481255-c25d-404e-9e58-e53327c43b67 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for user 267a2b59a70245dfb7ec1b779f7fdd51 and project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'key_pairs'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:25:55.085572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-af481255-c25d-404e-9e58-e53327c43b67 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.216529 Jun 03 13:25:55.086821 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 271/487] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 13:25:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:55.114948 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ca2291ba-2448-4c72-81a2-e489fdaeea65 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:55.115848 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ca2291ba-2448-4c72-81a2-e489fdaeea65 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:55.123922 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ca2291ba-2448-4c72-81a2-e489fdaeea65 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:55.125283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ca2291ba-2448-4c72-81a2-e489fdaeea65 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:55.126369 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ca2291ba-2448-4c72-81a2-e489fdaeea65 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:55.127045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ca2291ba-2448-4c72-81a2-e489fdaeea65 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:55.589126 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ca2291ba-2448-4c72-81a2-e489fdaeea65 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:55.614049 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ca2291ba-2448-4c72-81a2-e489fdaeea65 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:55.615856 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ca2291ba-2448-4c72-81a2-e489fdaeea65 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:55.617092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ca2291ba-2448-4c72-81a2-e489fdaeea65 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.506292 Jun 03 13:25:55.638901 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 217/488] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:55 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:55.883302 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d3afb0f6-ded5-4c79-925f-2733762169dc tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:55.883913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d3afb0f6-ded5-4c79-925f-2733762169dc tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:55.897834 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d3afb0f6-ded5-4c79-925f-2733762169dc tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:55.898518 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d3afb0f6-ded5-4c79-925f-2733762169dc tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:55.899538 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d3afb0f6-ded5-4c79-925f-2733762169dc tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:55.900705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d3afb0f6-ded5-4c79-925f-2733762169dc tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:56.177505 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d3afb0f6-ded5-4c79-925f-2733762169dc tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:56.193367 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d3afb0f6-ded5-4c79-925f-2733762169dc tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1709 microversion: 2.1 time: 0.315078 Jun 03 13:25:56.194168 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 272/489] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:55 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1709 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:56.639735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e99bb440-4741-463d-8798-7837f7ae065f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:56.647791 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e99bb440-4741-463d-8798-7837f7ae065f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:56.675074 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e99bb440-4741-463d-8798-7837f7ae065f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:56.708551 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e99bb440-4741-463d-8798-7837f7ae065f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:56.708551 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e99bb440-4741-463d-8798-7837f7ae065f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:56.708551 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e99bb440-4741-463d-8798-7837f7ae065f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:56.968491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e99bb440-4741-463d-8798-7837f7ae065f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:56.976493 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e99bb440-4741-463d-8798-7837f7ae065f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:56.978389 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e99bb440-4741-463d-8798-7837f7ae065f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:56.979628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e99bb440-4741-463d-8798-7837f7ae065f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.348226 Jun 03 13:25:56.980209 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 218/490] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:56 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:57.211107 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f5092f33-509f-43a6-96c7-230911fd8666 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:57.211704 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f5092f33-509f-43a6-96c7-230911fd8666 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:57.217840 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f5092f33-509f-43a6-96c7-230911fd8666 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:57.218288 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f5092f33-509f-43a6-96c7-230911fd8666 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:57.219039 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f5092f33-509f-43a6-96c7-230911fd8666 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:57.219474 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f5092f33-509f-43a6-96c7-230911fd8666 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:57.363641 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f5092f33-509f-43a6-96c7-230911fd8666 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:57.373991 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f5092f33-509f-43a6-96c7-230911fd8666 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1709 microversion: 2.1 time: 0.166626 Jun 03 13:25:57.374556 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 273/491] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:57 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1709 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:57.999195 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c01d246f-7ee6-4ad5-88df-b80fae973375 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:58.000568 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-c01d246f-7ee6-4ad5-88df-b80fae973375 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:58.012466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:58.012466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c01d246f-7ee6-4ad5-88df-b80fae973375 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:58.012466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c01d246f-7ee6-4ad5-88df-b80fae973375 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:58.014265 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c01d246f-7ee6-4ad5-88df-b80fae973375 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:58.014948 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c01d246f-7ee6-4ad5-88df-b80fae973375 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:58.339286 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c01d246f-7ee6-4ad5-88df-b80fae973375 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:58.351672 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c01d246f-7ee6-4ad5-88df-b80fae973375 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:58.354258 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c01d246f-7ee6-4ad5-88df-b80fae973375 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:58.355690 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c01d246f-7ee6-4ad5-88df-b80fae973375 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.361507 Jun 03 13:25:58.367394 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 219/492] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:57 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:58.391229 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8d66b4df-33e2-49de-a5c6-8cf63ea3a148 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:58.391843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8d66b4df-33e2-49de-a5c6-8cf63ea3a148 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:58.398482 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8d66b4df-33e2-49de-a5c6-8cf63ea3a148 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:58.399017 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8d66b4df-33e2-49de-a5c6-8cf63ea3a148 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:58.400099 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8d66b4df-33e2-49de-a5c6-8cf63ea3a148 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:58.400876 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8d66b4df-33e2-49de-a5c6-8cf63ea3a148 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:58.565153 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8d66b4df-33e2-49de-a5c6-8cf63ea3a148 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:58.573734 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8d66b4df-33e2-49de-a5c6-8cf63ea3a148 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1713 microversion: 2.1 time: 0.186659 Jun 03 13:25:58.576193 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 274/493] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:58 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1713 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:58.955350 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-490671345", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "933d7ba3-7582-451a-82dc-0b343d5ac36c"}], "security_groups": [{"name": "tempest-securitygroup--534472044"}], "key_name": "tempest-keypair-311302372", "user_data": "}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:59.063671 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.network.neutron [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] validate_networks() for [('933d7ba3-7582-451a-82dc-0b343d5ac36c', None, None, None, None, None)] {{(pid=118178) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:25:59.376838 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a89fa8cc-0bae-43f9-81ab-6cb3c0eee5fa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:59.377450 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a89fa8cc-0bae-43f9-81ab-6cb3c0eee5fa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:59.386886 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a89fa8cc-0bae-43f9-81ab-6cb3c0eee5fa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:59.387338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a89fa8cc-0bae-43f9-81ab-6cb3c0eee5fa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:59.388102 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a89fa8cc-0bae-43f9-81ab-6cb3c0eee5fa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:59.388557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a89fa8cc-0bae-43f9-81ab-6cb3c0eee5fa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:59.481292 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Flavor limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:25:59.482855 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Image limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:25:59.483548 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Flavor pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:25:59.484541 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Image pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:25:59.497112 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:25:59.508534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:59.512317 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:59.512317 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:59.512317 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:59.519723 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:59.532779 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:25:59.538917 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for user 267a2b59a70245dfb7ec1b779f7fdd51 and project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:25:59.543193 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a89fa8cc-0bae-43f9-81ab-6cb3c0eee5fa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:59.552953 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a89fa8cc-0bae-43f9-81ab-6cb3c0eee5fa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:59.553329 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Going to run 1 instances... {{(pid=118178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:25:59.554481 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a89fa8cc-0bae-43f9-81ab-6cb3c0eee5fa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:59.555641 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a89fa8cc-0bae-43f9-81ab-6cb3c0eee5fa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1742 microversion: 2.20 time: 0.184505 Jun 03 13:25:59.556745 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:25:59.560512 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 275/494] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:25:59 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1742 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:25:59.758161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-7744c125-b5bc-46ed-9dc4-4f2818595cfb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.807411 Jun 03 13:25:59.758806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 220/495] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:25:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:25:59.769790 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7b63ea9f-45b1-4766-acd3-1108d1180579 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:59.777888 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7b63ea9f-45b1-4766-acd3-1108d1180579 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:59.840362 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7b63ea9f-45b1-4766-acd3-1108d1180579 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:59.849122 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7b63ea9f-45b1-4766-acd3-1108d1180579 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1240 microversion: 2.1 time: 0.083083 Jun 03 13:25:59.853948 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 276/496] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:59 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:00.585150 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-db25c9be-ca61-4053-841c-82135d6c3741 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:00.585939 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-db25c9be-ca61-4053-841c-82135d6c3741 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:00.596049 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-db25c9be-ca61-4053-841c-82135d6c3741 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:00.596670 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-db25c9be-ca61-4053-841c-82135d6c3741 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:00.597563 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-db25c9be-ca61-4053-841c-82135d6c3741 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:00.598113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-db25c9be-ca61-4053-841c-82135d6c3741 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:00.751399 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-db25c9be-ca61-4053-841c-82135d6c3741 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:00.759307 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-db25c9be-ca61-4053-841c-82135d6c3741 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:00.761011 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-db25c9be-ca61-4053-841c-82135d6c3741 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:00.762164 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-db25c9be-ca61-4053-841c-82135d6c3741 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1724 microversion: 2.20 time: 0.191583 Jun 03 13:26:00.762760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 221/497] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:00 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:00.866903 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8a51efeb-627a-4308-a414-92c4087bf906 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:00.867559 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8a51efeb-627a-4308-a414-92c4087bf906 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:00.874282 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8a51efeb-627a-4308-a414-92c4087bf906 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:00.874725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8a51efeb-627a-4308-a414-92c4087bf906 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:00.875535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8a51efeb-627a-4308-a414-92c4087bf906 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:00.875960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8a51efeb-627a-4308-a414-92c4087bf906 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:00.937989 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8a51efeb-627a-4308-a414-92c4087bf906 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:00.945520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8a51efeb-627a-4308-a414-92c4087bf906 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1244 microversion: 2.1 time: 0.082681 Jun 03 13:26:00.946087 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 277/498] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:00 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:01.785346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ae03970e-44fa-4e31-abf6-39547580c5fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:01.785871 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ae03970e-44fa-4e31-abf6-39547580c5fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:01.792582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ae03970e-44fa-4e31-abf6-39547580c5fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:01.792948 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ae03970e-44fa-4e31-abf6-39547580c5fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:01.793707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ae03970e-44fa-4e31-abf6-39547580c5fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:01.794135 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ae03970e-44fa-4e31-abf6-39547580c5fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:01.870475 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-095a54a8-e740-4d43-b440-062d772c3820 req-30ec9d82-6c4b-4431-8b43-bc16e2c93aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f119f5f-b6ed-45a0-a780-b1e037c96cc1", "name": "network-vif-unplugged", "status": "completed", "tag": "14995843-d975-4a00-9ad9-746c61f720d5"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:01.880577 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-095a54a8-e740-4d43-b440-062d772c3820 req-30ec9d82-6c4b-4431-8b43-bc16e2c93aca service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:01.881041 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-095a54a8-e740-4d43-b440-062d772c3820 req-30ec9d82-6c4b-4431-8b43-bc16e2c93aca service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:01.894343 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-095a54a8-e740-4d43-b440-062d772c3820 req-30ec9d82-6c4b-4431-8b43-bc16e2c93aca service nova] Creating event network-vif-unplugged:14995843-d975-4a00-9ad9-746c61f720d5 for instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 on hv-cinder-80135 Jun 03 13:26:01.899394 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-095a54a8-e740-4d43-b440-062d772c3820 req-30ec9d82-6c4b-4431-8b43-bc16e2c93aca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033215 Jun 03 13:26:01.900397 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 278/499] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:26:01.934417 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ae03970e-44fa-4e31-abf6-39547580c5fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:01.942184 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ae03970e-44fa-4e31-abf6-39547580c5fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:01.943676 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ae03970e-44fa-4e31-abf6-39547580c5fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:01.944838 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ae03970e-44fa-4e31-abf6-39547580c5fc tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1724 microversion: 2.20 time: 0.163445 Jun 03 13:26:01.945392 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 222/500] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:01 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:01.962933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5ef73ac9-5db3-4104-bc9d-3232e6cf1c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:01.963805 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5ef73ac9-5db3-4104-bc9d-3232e6cf1c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:01.969998 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ef73ac9-5db3-4104-bc9d-3232e6cf1c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:01.975243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ef73ac9-5db3-4104-bc9d-3232e6cf1c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:01.975243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ef73ac9-5db3-4104-bc9d-3232e6cf1c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:01.975243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ef73ac9-5db3-4104-bc9d-3232e6cf1c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:02.046193 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5ef73ac9-5db3-4104-bc9d-3232e6cf1c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:02.053470 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5ef73ac9-5db3-4104-bc9d-3232e6cf1c1e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1244 microversion: 2.1 time: 0.094709 Jun 03 13:26:02.054037 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 279/501] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:01 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:02.963720 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e2d15efd-62d5-40dc-906c-bccc57a1e4a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:02.969142 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e2d15efd-62d5-40dc-906c-bccc57a1e4a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:02.970695 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e2d15efd-62d5-40dc-906c-bccc57a1e4a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:02.971203 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e2d15efd-62d5-40dc-906c-bccc57a1e4a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:02.972260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e2d15efd-62d5-40dc-906c-bccc57a1e4a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:02.972761 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e2d15efd-62d5-40dc-906c-bccc57a1e4a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:03.070950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6c3098c5-8891-4c24-a8cd-3130a5b25094 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:03.076832 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6c3098c5-8891-4c24-a8cd-3130a5b25094 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:03.079352 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6c3098c5-8891-4c24-a8cd-3130a5b25094 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:03.079807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6c3098c5-8891-4c24-a8cd-3130a5b25094 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:03.080622 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6c3098c5-8891-4c24-a8cd-3130a5b25094 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:03.081058 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6c3098c5-8891-4c24-a8cd-3130a5b25094 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:03.111690 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e2d15efd-62d5-40dc-906c-bccc57a1e4a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:03.120827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e2d15efd-62d5-40dc-906c-bccc57a1e4a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:03.122630 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e2d15efd-62d5-40dc-906c-bccc57a1e4a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:03.123804 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e2d15efd-62d5-40dc-906c-bccc57a1e4a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1727 microversion: 2.20 time: 0.164881 Jun 03 13:26:03.128203 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 223/502] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:02 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:03.147012 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dfa5af80-f8c8-4254-a64a-71f9f846ed94 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a4ae9af-643b-462e-a4e1-36b9e568b262"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:03.148454 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dfa5af80-f8c8-4254-a64a-71f9f846ed94 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:03.152741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6c3098c5-8891-4c24-a8cd-3130a5b25094 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:03.156064 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfa5af80-f8c8-4254-a64a-71f9f846ed94 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:03.156448 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfa5af80-f8c8-4254-a64a-71f9f846ed94 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:03.157193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfa5af80-f8c8-4254-a64a-71f9f846ed94 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:03.157631 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfa5af80-f8c8-4254-a64a-71f9f846ed94 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:03.159843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6c3098c5-8891-4c24-a8cd-3130a5b25094 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1292 microversion: 2.1 time: 0.092829 Jun 03 13:26:03.163673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 280/503] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:03 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:04.176452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-87e8b68d-0317-4be2-ad1e-94887522e046 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:04.178155 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-87e8b68d-0317-4be2-ad1e-94887522e046 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:04.185305 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-87e8b68d-0317-4be2-ad1e-94887522e046 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:04.185757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-87e8b68d-0317-4be2-ad1e-94887522e046 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:04.186722 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-87e8b68d-0317-4be2-ad1e-94887522e046 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:04.187157 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-87e8b68d-0317-4be2-ad1e-94887522e046 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:04.251805 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-87e8b68d-0317-4be2-ad1e-94887522e046 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:04.259526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-87e8b68d-0317-4be2-ad1e-94887522e046 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1310 microversion: 2.1 time: 0.086885 Jun 03 13:26:04.260108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 281/504] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:04 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:04.312681 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dfa5af80-f8c8-4254-a64a-71f9f846ed94 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "POST /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.172756 Jun 03 13:26:04.315533 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 224/505] 10.222.0.61 () {62 vars in 1363 bytes} [Fri Jun 3 13:26:03 2022] POST /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-volume_attachments => generated 188 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 13:26:04.433725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3dad4d7e-c5f8-4070-9e06-9954220cdae8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:04.434268 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3dad4d7e-c5f8-4070-9e06-9954220cdae8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:04.440709 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3dad4d7e-c5f8-4070-9e06-9954220cdae8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:04.441167 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3dad4d7e-c5f8-4070-9e06-9954220cdae8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:04.441966 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3dad4d7e-c5f8-4070-9e06-9954220cdae8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:04.442422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3dad4d7e-c5f8-4070-9e06-9954220cdae8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:04.596935 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:04.720397 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3dad4d7e-c5f8-4070-9e06-9954220cdae8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "POST /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/action" status: 202 len: 0 microversion: 2.20 time: 0.291487 Jun 03 13:26:04.724267 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 282/506] 10.222.0.61 () {62 vars in 1318 bytes} [Fri Jun 3 13:26:04 2022] POST /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 03 13:26:04.730018 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a17b389f-98ff-428c-a9ab-292c04054aff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:04.730637 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a17b389f-98ff-428c-a9ab-292c04054aff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:04.737611 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a17b389f-98ff-428c-a9ab-292c04054aff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:04.738275 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a17b389f-98ff-428c-a9ab-292c04054aff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:04.739052 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a17b389f-98ff-428c-a9ab-292c04054aff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:04.739491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a17b389f-98ff-428c-a9ab-292c04054aff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:04.994844 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a17b389f-98ff-428c-a9ab-292c04054aff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:05.011453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a17b389f-98ff-428c-a9ab-292c04054aff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:05.013074 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a17b389f-98ff-428c-a9ab-292c04054aff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:05.014242 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a17b389f-98ff-428c-a9ab-292c04054aff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1753 microversion: 2.20 time: 0.288894 Jun 03 13:26:05.015058 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 225/507] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:04 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1753 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:05.279293 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-62512735-3e77-47ce-9368-54a56215970c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:05.281224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-62512735-3e77-47ce-9368-54a56215970c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:05.289380 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-62512735-3e77-47ce-9368-54a56215970c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:05.290277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-62512735-3e77-47ce-9368-54a56215970c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:05.291298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-62512735-3e77-47ce-9368-54a56215970c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:05.292003 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-62512735-3e77-47ce-9368-54a56215970c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:05.442092 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-62512735-3e77-47ce-9368-54a56215970c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:05.451636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-62512735-3e77-47ce-9368-54a56215970c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.177752 Jun 03 13:26:05.453050 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 283/508] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:05 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:06.034544 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3321818a-c91e-43d7-8174-de954c0913dd tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:06.036015 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3321818a-c91e-43d7-8174-de954c0913dd tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:06.045168 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3321818a-c91e-43d7-8174-de954c0913dd tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:06.045839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3321818a-c91e-43d7-8174-de954c0913dd tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:06.062008 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3321818a-c91e-43d7-8174-de954c0913dd tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:06.062659 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3321818a-c91e-43d7-8174-de954c0913dd tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:06.209681 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3321818a-c91e-43d7-8174-de954c0913dd tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:06.222869 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3321818a-c91e-43d7-8174-de954c0913dd tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:06.225140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3321818a-c91e-43d7-8174-de954c0913dd tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:06.225835 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3321818a-c91e-43d7-8174-de954c0913dd tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1753 microversion: 2.20 time: 0.195503 Jun 03 13:26:06.226395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 226/509] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:06 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1753 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:06.476518 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a0874d7e-1ce7-438f-94c8-408bc5f36e52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:06.478078 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a0874d7e-1ce7-438f-94c8-408bc5f36e52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:06.489785 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a0874d7e-1ce7-438f-94c8-408bc5f36e52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:06.490241 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a0874d7e-1ce7-438f-94c8-408bc5f36e52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:06.491022 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a0874d7e-1ce7-438f-94c8-408bc5f36e52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:06.491464 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a0874d7e-1ce7-438f-94c8-408bc5f36e52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:06.678222 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-b5aa8377-f71e-41fd-85ff-21e63ba9d9b5 req-5ca14041-e351-43bb-81b4-2b8655e5695e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c95a8052-ebb8-4326-83e4-85340beb68e7", "tag": "20ec12a9-5558-4ed8-a89c-b0b033b62225"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:06.683647 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-b5aa8377-f71e-41fd-85ff-21e63ba9d9b5 req-5ca14041-e351-43bb-81b4-2b8655e5695e service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:06.684537 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-b5aa8377-f71e-41fd-85ff-21e63ba9d9b5 req-5ca14041-e351-43bb-81b4-2b8655e5695e service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:06.716291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-b5aa8377-f71e-41fd-85ff-21e63ba9d9b5 req-5ca14041-e351-43bb-81b4-2b8655e5695e service nova] Creating event network-changed:20ec12a9-5558-4ed8-a89c-b0b033b62225 for instance c95a8052-ebb8-4326-83e4-85340beb68e7 on hv-cinder-80135 Jun 03 13:26:06.734842 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-b5aa8377-f71e-41fd-85ff-21e63ba9d9b5 req-5ca14041-e351-43bb-81b4-2b8655e5695e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061901 Jun 03 13:26:06.734842 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 227/510] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:26:06.842914 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a0874d7e-1ce7-438f-94c8-408bc5f36e52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:06.853574 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a0874d7e-1ce7-438f-94c8-408bc5f36e52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.384111 Jun 03 13:26:06.863653 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 284/511] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:06 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:07.247622 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6f39b386-9299-44b6-9a03-2b5c3a34c45a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:07.249534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6f39b386-9299-44b6-9a03-2b5c3a34c45a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:07.256126 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6f39b386-9299-44b6-9a03-2b5c3a34c45a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:07.256661 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6f39b386-9299-44b6-9a03-2b5c3a34c45a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:07.257446 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6f39b386-9299-44b6-9a03-2b5c3a34c45a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:07.257892 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6f39b386-9299-44b6-9a03-2b5c3a34c45a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:07.521823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6f39b386-9299-44b6-9a03-2b5c3a34c45a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:07.540074 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6f39b386-9299-44b6-9a03-2b5c3a34c45a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:07.543231 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6f39b386-9299-44b6-9a03-2b5c3a34c45a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:07.546498 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6f39b386-9299-44b6-9a03-2b5c3a34c45a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1755 microversion: 2.20 time: 0.303744 Jun 03 13:26:07.547284 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 228/512] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:07 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1755 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:26:07.878825 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9ccfa392-d161-4c78-8603-4f19f5142813 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:07.879987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9ccfa392-d161-4c78-8603-4f19f5142813 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:07.896876 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9ccfa392-d161-4c78-8603-4f19f5142813 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:07.897329 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9ccfa392-d161-4c78-8603-4f19f5142813 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:07.898097 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9ccfa392-d161-4c78-8603-4f19f5142813 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:07.898648 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9ccfa392-d161-4c78-8603-4f19f5142813 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:08.096445 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9ccfa392-d161-4c78-8603-4f19f5142813 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:08.106066 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9ccfa392-d161-4c78-8603-4f19f5142813 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.239179 Jun 03 13:26:08.110798 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 285/513] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:07 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:08.566081 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a61e6675-84d0-472f-833c-4d315e828419 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:08.566784 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a61e6675-84d0-472f-833c-4d315e828419 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:08.575342 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a61e6675-84d0-472f-833c-4d315e828419 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:08.575883 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a61e6675-84d0-472f-833c-4d315e828419 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:08.576825 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a61e6675-84d0-472f-833c-4d315e828419 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:08.577333 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a61e6675-84d0-472f-833c-4d315e828419 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:08.737367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a61e6675-84d0-472f-833c-4d315e828419 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:08.747037 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a61e6675-84d0-472f-833c-4d315e828419 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:08.749083 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a61e6675-84d0-472f-833c-4d315e828419 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:08.750286 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a61e6675-84d0-472f-833c-4d315e828419 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1755 microversion: 2.20 time: 0.188388 Jun 03 13:26:08.750846 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 229/514] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:08 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:26:09.124013 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6ee0c48d-25db-4f1a-ab37-17c5d4465658 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:09.125344 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6ee0c48d-25db-4f1a-ab37-17c5d4465658 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:09.132006 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6ee0c48d-25db-4f1a-ab37-17c5d4465658 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:09.137172 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6ee0c48d-25db-4f1a-ab37-17c5d4465658 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:09.137172 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6ee0c48d-25db-4f1a-ab37-17c5d4465658 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:09.137172 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6ee0c48d-25db-4f1a-ab37-17c5d4465658 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:09.340329 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6ee0c48d-25db-4f1a-ab37-17c5d4465658 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:09.349507 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6ee0c48d-25db-4f1a-ab37-17c5d4465658 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.229802 Jun 03 13:26:09.350639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 286/515] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:09 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:09.769529 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a61ef377-7b34-4c5a-b7b4-5e4d57421980 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:09.770157 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a61ef377-7b34-4c5a-b7b4-5e4d57421980 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:09.772254 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:09.773305 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=6 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:09.784826 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a61ef377-7b34-4c5a-b7b4-5e4d57421980 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:09.785605 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a61ef377-7b34-4c5a-b7b4-5e4d57421980 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:09.786840 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a61ef377-7b34-4c5a-b7b4-5e4d57421980 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:09.787471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a61ef377-7b34-4c5a-b7b4-5e4d57421980 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:09.973633 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a61ef377-7b34-4c5a-b7b4-5e4d57421980 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:09.983526 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a61ef377-7b34-4c5a-b7b4-5e4d57421980 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:09.985443 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a61ef377-7b34-4c5a-b7b4-5e4d57421980 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:09.995260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a61ef377-7b34-4c5a-b7b4-5e4d57421980 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1755 microversion: 2.20 time: 0.229863 Jun 03 13:26:10.018740 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 230/516] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:09 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1755 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:10.363680 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=6 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:10.370173 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3e47fb79-c2f2-4f04-9dde-32a6c1eeb344 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:10.371915 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3e47fb79-c2f2-4f04-9dde-32a6c1eeb344 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:10.380621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3e47fb79-c2f2-4f04-9dde-32a6c1eeb344 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:10.381321 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3e47fb79-c2f2-4f04-9dde-32a6c1eeb344 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:10.382279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3e47fb79-c2f2-4f04-9dde-32a6c1eeb344 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:10.382881 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3e47fb79-c2f2-4f04-9dde-32a6c1eeb344 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:10.626384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3e47fb79-c2f2-4f04-9dde-32a6c1eeb344 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:10.636097 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3e47fb79-c2f2-4f04-9dde-32a6c1eeb344 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.272912 Jun 03 13:26:10.637090 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 287/517] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:10 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:11.014951 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-bab105e1-2c0b-4ae5-ac23-2ffeba87c804 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:11.015596 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-bab105e1-2c0b-4ae5-ac23-2ffeba87c804 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:11.022914 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bab105e1-2c0b-4ae5-ac23-2ffeba87c804 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:11.028627 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bab105e1-2c0b-4ae5-ac23-2ffeba87c804 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:11.029491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bab105e1-2c0b-4ae5-ac23-2ffeba87c804 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:11.029938 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bab105e1-2c0b-4ae5-ac23-2ffeba87c804 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:11.173617 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-bab105e1-2c0b-4ae5-ac23-2ffeba87c804 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:11.182198 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-bab105e1-2c0b-4ae5-ac23-2ffeba87c804 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:11.183692 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-bab105e1-2c0b-4ae5-ac23-2ffeba87c804 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:11.184919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-bab105e1-2c0b-4ae5-ac23-2ffeba87c804 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1755 microversion: 2.20 time: 0.174100 Jun 03 13:26:11.185464 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 231/518] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:11 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:26:11.654510 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0c7e63f1-2af5-4822-9f99-b2f90fa9660d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:11.656261 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0c7e63f1-2af5-4822-9f99-b2f90fa9660d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:11.663906 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0c7e63f1-2af5-4822-9f99-b2f90fa9660d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:11.665275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0c7e63f1-2af5-4822-9f99-b2f90fa9660d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:11.666691 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0c7e63f1-2af5-4822-9f99-b2f90fa9660d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:11.667345 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0c7e63f1-2af5-4822-9f99-b2f90fa9660d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:11.854669 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0c7e63f1-2af5-4822-9f99-b2f90fa9660d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:11.863146 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0c7e63f1-2af5-4822-9f99-b2f90fa9660d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.213705 Jun 03 13:26:11.863868 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 288/519] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:11 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:12.202893 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3f43aaf8-a414-4f67-90be-5d7f6dda7967 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:12.203769 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3f43aaf8-a414-4f67-90be-5d7f6dda7967 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:12.210711 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3f43aaf8-a414-4f67-90be-5d7f6dda7967 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:12.211504 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3f43aaf8-a414-4f67-90be-5d7f6dda7967 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:12.213488 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3f43aaf8-a414-4f67-90be-5d7f6dda7967 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:12.214150 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3f43aaf8-a414-4f67-90be-5d7f6dda7967 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:12.392524 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3f43aaf8-a414-4f67-90be-5d7f6dda7967 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:12.401804 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3f43aaf8-a414-4f67-90be-5d7f6dda7967 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:12.403339 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3f43aaf8-a414-4f67-90be-5d7f6dda7967 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:12.404743 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3f43aaf8-a414-4f67-90be-5d7f6dda7967 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.205780 Jun 03 13:26:12.413803 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 232/520] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:12 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:26:12.636325 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-b4b3ae2c-fbd8-4e48-9df1-04ffe728aae4 req-43ffbc28-1fe5-47c7-b60d-913c896467f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95a8052-ebb8-4326-83e4-85340beb68e7", "name": "network-vif-plugged", "status": "completed", "tag": "20ec12a9-5558-4ed8-a89c-b0b033b62225"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:12.647824 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-b4b3ae2c-fbd8-4e48-9df1-04ffe728aae4 req-43ffbc28-1fe5-47c7-b60d-913c896467f1 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:12.650431 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-b4b3ae2c-fbd8-4e48-9df1-04ffe728aae4 req-43ffbc28-1fe5-47c7-b60d-913c896467f1 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:12.663977 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-b4b3ae2c-fbd8-4e48-9df1-04ffe728aae4 req-43ffbc28-1fe5-47c7-b60d-913c896467f1 service nova] Creating event network-vif-plugged:20ec12a9-5558-4ed8-a89c-b0b033b62225 for instance c95a8052-ebb8-4326-83e4-85340beb68e7 on hv-cinder-80135 Jun 03 13:26:12.670151 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-b4b3ae2c-fbd8-4e48-9df1-04ffe728aae4 req-43ffbc28-1fe5-47c7-b60d-913c896467f1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037666 Jun 03 13:26:12.671088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 289/521] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:26:12.881210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ecf8881e-a36e-43d5-8f31-16c1d596fe69 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:12.881825 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ecf8881e-a36e-43d5-8f31-16c1d596fe69 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:12.889867 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ecf8881e-a36e-43d5-8f31-16c1d596fe69 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:12.890493 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ecf8881e-a36e-43d5-8f31-16c1d596fe69 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:12.891441 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ecf8881e-a36e-43d5-8f31-16c1d596fe69 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:12.892185 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ecf8881e-a36e-43d5-8f31-16c1d596fe69 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:13.100743 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ecf8881e-a36e-43d5-8f31-16c1d596fe69 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:13.115204 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ecf8881e-a36e-43d5-8f31-16c1d596fe69 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.237654 Jun 03 13:26:13.125710 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 233/522] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:12 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:13.425875 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9be3b901-09e4-429b-9bc1-0aad2d0ede27 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:13.426734 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9be3b901-09e4-429b-9bc1-0aad2d0ede27 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:13.437953 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9be3b901-09e4-429b-9bc1-0aad2d0ede27 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:13.441045 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9be3b901-09e4-429b-9bc1-0aad2d0ede27 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:13.441914 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9be3b901-09e4-429b-9bc1-0aad2d0ede27 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:13.444297 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9be3b901-09e4-429b-9bc1-0aad2d0ede27 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:13.862927 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9be3b901-09e4-429b-9bc1-0aad2d0ede27 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:13.887059 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9be3b901-09e4-429b-9bc1-0aad2d0ede27 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:13.894022 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9be3b901-09e4-429b-9bc1-0aad2d0ede27 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:13.895467 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9be3b901-09e4-429b-9bc1-0aad2d0ede27 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.476182 Jun 03 13:26:13.910523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 290/523] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:13 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:14.134003 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-574cc79e-f959-474f-960a-4eab75cffe71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:14.137058 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-574cc79e-f959-474f-960a-4eab75cffe71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:14.147508 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-574cc79e-f959-474f-960a-4eab75cffe71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:14.148720 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-574cc79e-f959-474f-960a-4eab75cffe71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:14.149954 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-574cc79e-f959-474f-960a-4eab75cffe71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:14.150677 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-574cc79e-f959-474f-960a-4eab75cffe71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:14.440316 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-574cc79e-f959-474f-960a-4eab75cffe71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:14.459406 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-574cc79e-f959-474f-960a-4eab75cffe71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.329919 Jun 03 13:26:14.470527 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 234/524] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:14 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:14.923526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-767bbdaf-8688-46a9-b45b-c4505a909c61 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:14.924194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-767bbdaf-8688-46a9-b45b-c4505a909c61 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:14.938502 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-767bbdaf-8688-46a9-b45b-c4505a909c61 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:14.939026 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-767bbdaf-8688-46a9-b45b-c4505a909c61 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:14.939805 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-767bbdaf-8688-46a9-b45b-c4505a909c61 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:14.940262 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-767bbdaf-8688-46a9-b45b-c4505a909c61 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:15.605493 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8682cd11-f5ef-4af1-b99e-3dd82a5c2e62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:15.605493 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8682cd11-f5ef-4af1-b99e-3dd82a5c2e62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:15.605493 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8682cd11-f5ef-4af1-b99e-3dd82a5c2e62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:15.605493 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8682cd11-f5ef-4af1-b99e-3dd82a5c2e62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:15.607440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8682cd11-f5ef-4af1-b99e-3dd82a5c2e62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:15.607440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8682cd11-f5ef-4af1-b99e-3dd82a5c2e62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:15.607440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:15.616405 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-767bbdaf-8688-46a9-b45b-c4505a909c61 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:15.701373 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8682cd11-f5ef-4af1-b99e-3dd82a5c2e62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:15.705525 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-767bbdaf-8688-46a9-b45b-c4505a909c61 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:15.707486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-767bbdaf-8688-46a9-b45b-c4505a909c61 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:15.709514 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8682cd11-f5ef-4af1-b99e-3dd82a5c2e62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.235461 Jun 03 13:26:15.710292 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 235/525] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:15 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:15.729662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-767bbdaf-8688-46a9-b45b-c4505a909c61 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.792988 Jun 03 13:26:15.729662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 291/526] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:14 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:16.734958 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-afe75aa5-ddbf-4e33-99cf-4b2554ed79b6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:16.737309 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-afe75aa5-ddbf-4e33-99cf-4b2554ed79b6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:16.749490 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-49f24d4c-ae23-4772-9542-9af22ec539c6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:16.750938 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-49f24d4c-ae23-4772-9542-9af22ec539c6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:16.772613 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-afe75aa5-ddbf-4e33-99cf-4b2554ed79b6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:16.772807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-49f24d4c-ae23-4772-9542-9af22ec539c6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:16.774276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-49f24d4c-ae23-4772-9542-9af22ec539c6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:16.776460 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-49f24d4c-ae23-4772-9542-9af22ec539c6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:16.777002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-afe75aa5-ddbf-4e33-99cf-4b2554ed79b6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:16.788050 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-afe75aa5-ddbf-4e33-99cf-4b2554ed79b6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:16.788050 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-afe75aa5-ddbf-4e33-99cf-4b2554ed79b6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:16.789159 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-49f24d4c-ae23-4772-9542-9af22ec539c6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:17.074520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-49f24d4c-ae23-4772-9542-9af22ec539c6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:17.083271 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-49f24d4c-ae23-4772-9542-9af22ec539c6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:17.084892 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-49f24d4c-ae23-4772-9542-9af22ec539c6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:17.086096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-49f24d4c-ae23-4772-9542-9af22ec539c6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.343609 Jun 03 13:26:17.093558 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 292/527] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:16 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:26:17.193204 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-afe75aa5-ddbf-4e33-99cf-4b2554ed79b6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:17.201611 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-afe75aa5-ddbf-4e33-99cf-4b2554ed79b6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.475573 Jun 03 13:26:17.202498 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 236/528] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:16 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:18.114822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-10833d51-da8a-459b-993e-4930fccf9373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:18.115445 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-10833d51-da8a-459b-993e-4930fccf9373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:18.123298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-10833d51-da8a-459b-993e-4930fccf9373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:18.123751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-10833d51-da8a-459b-993e-4930fccf9373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:18.124636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-10833d51-da8a-459b-993e-4930fccf9373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:18.125155 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-10833d51-da8a-459b-993e-4930fccf9373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:18.233636 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a5fdb800-546e-4585-ac77-7c8b6dae3b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:18.234077 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a5fdb800-546e-4585-ac77-7c8b6dae3b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:18.244116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a5fdb800-546e-4585-ac77-7c8b6dae3b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:18.249462 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a5fdb800-546e-4585-ac77-7c8b6dae3b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:18.260063 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a5fdb800-546e-4585-ac77-7c8b6dae3b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:18.260063 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a5fdb800-546e-4585-ac77-7c8b6dae3b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:18.353962 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-10833d51-da8a-459b-993e-4930fccf9373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:18.369329 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-10833d51-da8a-459b-993e-4930fccf9373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:18.371040 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-10833d51-da8a-459b-993e-4930fccf9373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:18.377258 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-10833d51-da8a-459b-993e-4930fccf9373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.266327 Jun 03 13:26:18.378773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 293/529] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:18 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:18.562927 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a5fdb800-546e-4585-ac77-7c8b6dae3b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:18.575107 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a5fdb800-546e-4585-ac77-7c8b6dae3b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.355028 Jun 03 13:26:18.577926 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 237/530] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:18 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:19.403108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-169b8465-2ac9-4d2b-ab88-e9812b9e56cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:19.403725 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-169b8465-2ac9-4d2b-ab88-e9812b9e56cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:19.420696 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-169b8465-2ac9-4d2b-ab88-e9812b9e56cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:19.422126 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-169b8465-2ac9-4d2b-ab88-e9812b9e56cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:19.422375 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-169b8465-2ac9-4d2b-ab88-e9812b9e56cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:19.422963 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-169b8465-2ac9-4d2b-ab88-e9812b9e56cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:19.596213 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6fcde909-96e7-4fa8-8e90-7520472c35ed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:19.596948 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6fcde909-96e7-4fa8-8e90-7520472c35ed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:19.606887 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6fcde909-96e7-4fa8-8e90-7520472c35ed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:19.609592 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6fcde909-96e7-4fa8-8e90-7520472c35ed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:19.611440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6fcde909-96e7-4fa8-8e90-7520472c35ed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:19.612091 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6fcde909-96e7-4fa8-8e90-7520472c35ed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:19.623651 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-169b8465-2ac9-4d2b-ab88-e9812b9e56cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:19.636483 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-169b8465-2ac9-4d2b-ab88-e9812b9e56cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:19.645373 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-169b8465-2ac9-4d2b-ab88-e9812b9e56cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:19.646833 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-169b8465-2ac9-4d2b-ab88-e9812b9e56cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.248208 Jun 03 13:26:19.647465 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 294/531] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:19 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:19.858303 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6fcde909-96e7-4fa8-8e90-7520472c35ed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:19.867008 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6fcde909-96e7-4fa8-8e90-7520472c35ed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.274901 Jun 03 13:26:19.868369 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 238/532] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:19 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:19.998784 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-da0fd85e-d024-40c5-8b09-dd9f7c4f9030 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Action: 'create', calling method: .version_select at 0x7f5bc8a15e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-453693398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4kjp/2XePD+yy+prc1qpGl4bsYkPnXqfhHFVfw9q5wZToWb1pfaNW4hFPTn6kB/8nktc6wzrdLU6oRk3iJQDTd24tN1JQ7QfZLEn2RhG4GmBPmriUi/gmeuXeVW9552Q=="}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:20.028452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-da0fd85e-d024-40c5-8b09-dd9f7c4f9030 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Getting quotas for project c880a17cc9844081bee38006d5b92f86. Resources: {'key_pairs'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:26:20.032597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-da0fd85e-d024-40c5-8b09-dd9f7c4f9030 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Getting quotas for user 77c56945d1d74a1eaa5e0c8f9e43f086 and project c880a17cc9844081bee38006d5b92f86. Resources: {'key_pairs'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:26:20.107763 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-da0fd85e-d024-40c5-8b09-dd9f7c4f9030 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.347687 Jun 03 13:26:20.108708 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 295/533] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 13:26:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:26:20.667797 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6129618f-e54d-413b-b1d6-28e81abac1c9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:20.668673 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6129618f-e54d-413b-b1d6-28e81abac1c9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:20.676108 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6129618f-e54d-413b-b1d6-28e81abac1c9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:20.676579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6129618f-e54d-413b-b1d6-28e81abac1c9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:20.677343 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6129618f-e54d-413b-b1d6-28e81abac1c9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:20.677950 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6129618f-e54d-413b-b1d6-28e81abac1c9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:20.832376 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6129618f-e54d-413b-b1d6-28e81abac1c9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:20.846729 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6129618f-e54d-413b-b1d6-28e81abac1c9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:20.849039 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6129618f-e54d-413b-b1d6-28e81abac1c9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:20.851377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6129618f-e54d-413b-b1d6-28e81abac1c9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.189189 Jun 03 13:26:20.862921 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 239/534] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:20 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:20.885618 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5c9b3fd1-d057-444a-bab3-a40b322f51c3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:20.886599 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5c9b3fd1-d057-444a-bab3-a40b322f51c3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:20.892331 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5c9b3fd1-d057-444a-bab3-a40b322f51c3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:20.897461 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5c9b3fd1-d057-444a-bab3-a40b322f51c3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:20.897461 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5c9b3fd1-d057-444a-bab3-a40b322f51c3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:20.897461 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5c9b3fd1-d057-444a-bab3-a40b322f51c3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:21.099209 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5c9b3fd1-d057-444a-bab3-a40b322f51c3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:21.114849 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5c9b3fd1-d057-444a-bab3-a40b322f51c3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.233689 Jun 03 13:26:21.115789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 296/535] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:20 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:21.870781 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-55431bdd-298d-4c6a-8e3f-415d655494b2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:21.871369 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-55431bdd-298d-4c6a-8e3f-415d655494b2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:21.878783 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-55431bdd-298d-4c6a-8e3f-415d655494b2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:21.880073 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-55431bdd-298d-4c6a-8e3f-415d655494b2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:21.881413 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-55431bdd-298d-4c6a-8e3f-415d655494b2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:21.882009 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-55431bdd-298d-4c6a-8e3f-415d655494b2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:22.085423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-55431bdd-298d-4c6a-8e3f-415d655494b2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:22.097019 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-55431bdd-298d-4c6a-8e3f-415d655494b2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:22.098803 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-55431bdd-298d-4c6a-8e3f-415d655494b2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:22.100549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-55431bdd-298d-4c6a-8e3f-415d655494b2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.234653 Jun 03 13:26:22.101350 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 240/536] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:21 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:22.133064 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7e717cb0-a42b-47cf-aa2e-d16a50be00fc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:22.133655 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7e717cb0-a42b-47cf-aa2e-d16a50be00fc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:22.140078 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7e717cb0-a42b-47cf-aa2e-d16a50be00fc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:22.142924 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7e717cb0-a42b-47cf-aa2e-d16a50be00fc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:22.142924 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7e717cb0-a42b-47cf-aa2e-d16a50be00fc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:22.142924 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7e717cb0-a42b-47cf-aa2e-d16a50be00fc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:22.404175 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7e717cb0-a42b-47cf-aa2e-d16a50be00fc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:22.412752 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7e717cb0-a42b-47cf-aa2e-d16a50be00fc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.284409 Jun 03 13:26:22.414260 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 297/537] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:22 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:23.120099 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0b89d619-def7-4af3-85ee-422b6333e581 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:23.120890 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0b89d619-def7-4af3-85ee-422b6333e581 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:23.144010 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0b89d619-def7-4af3-85ee-422b6333e581 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:23.144010 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0b89d619-def7-4af3-85ee-422b6333e581 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:23.144010 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0b89d619-def7-4af3-85ee-422b6333e581 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:23.144010 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0b89d619-def7-4af3-85ee-422b6333e581 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:23.363354 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0b89d619-def7-4af3-85ee-422b6333e581 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:23.380410 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0b89d619-def7-4af3-85ee-422b6333e581 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:23.382296 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0b89d619-def7-4af3-85ee-422b6333e581 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:23.383685 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0b89d619-def7-4af3-85ee-422b6333e581 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.268291 Jun 03 13:26:23.384889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 241/538] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:23 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:23.432569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-97cf6920-058c-4fc0-a3d7-df2ffc0b810c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:23.433308 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-97cf6920-058c-4fc0-a3d7-df2ffc0b810c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:23.435676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:23.449450 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-97cf6920-058c-4fc0-a3d7-df2ffc0b810c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:23.450320 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-97cf6920-058c-4fc0-a3d7-df2ffc0b810c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:23.451456 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-97cf6920-058c-4fc0-a3d7-df2ffc0b810c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:23.452427 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-97cf6920-058c-4fc0-a3d7-df2ffc0b810c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:23.690603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-97cf6920-058c-4fc0-a3d7-df2ffc0b810c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:23.700191 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-97cf6920-058c-4fc0-a3d7-df2ffc0b810c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.272803 Jun 03 13:26:23.701458 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 298/539] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:23 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:24.403558 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d50511ed-f5f2-41ad-aebc-b3e520cd486b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:24.404863 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d50511ed-f5f2-41ad-aebc-b3e520cd486b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:24.412603 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d50511ed-f5f2-41ad-aebc-b3e520cd486b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:24.413047 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d50511ed-f5f2-41ad-aebc-b3e520cd486b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:24.413822 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d50511ed-f5f2-41ad-aebc-b3e520cd486b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:24.414259 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d50511ed-f5f2-41ad-aebc-b3e520cd486b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:24.587960 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d50511ed-f5f2-41ad-aebc-b3e520cd486b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:24.599943 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d50511ed-f5f2-41ad-aebc-b3e520cd486b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:24.601654 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d50511ed-f5f2-41ad-aebc-b3e520cd486b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:24.603005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d50511ed-f5f2-41ad-aebc-b3e520cd486b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.204126 Jun 03 13:26:24.603847 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 242/540] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:24 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:24.718847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a80fdaf8-2692-499a-86d7-023761328e70 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:24.719484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a80fdaf8-2692-499a-86d7-023761328e70 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:24.725987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a80fdaf8-2692-499a-86d7-023761328e70 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:24.726437 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a80fdaf8-2692-499a-86d7-023761328e70 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:24.727192 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a80fdaf8-2692-499a-86d7-023761328e70 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:24.727694 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a80fdaf8-2692-499a-86d7-023761328e70 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:24.871581 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a80fdaf8-2692-499a-86d7-023761328e70 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:24.881915 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a80fdaf8-2692-499a-86d7-023761328e70 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.166964 Jun 03 13:26:24.882500 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 299/541] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:24 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:25.621589 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e3e5aac2-d4f7-4edc-9dc4-5e70793136a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:25.622439 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e3e5aac2-d4f7-4edc-9dc4-5e70793136a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:25.629076 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e3e5aac2-d4f7-4edc-9dc4-5e70793136a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:25.629528 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e3e5aac2-d4f7-4edc-9dc4-5e70793136a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:25.630292 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e3e5aac2-d4f7-4edc-9dc4-5e70793136a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:25.630732 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e3e5aac2-d4f7-4edc-9dc4-5e70793136a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:25.760508 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e3e5aac2-d4f7-4edc-9dc4-5e70793136a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:25.769639 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e3e5aac2-d4f7-4edc-9dc4-5e70793136a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:25.771139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e3e5aac2-d4f7-4edc-9dc4-5e70793136a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:25.772379 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e3e5aac2-d4f7-4edc-9dc4-5e70793136a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.154768 Jun 03 13:26:25.772882 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 243/542] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:25 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:25.899179 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-772fa684-edd7-4f86-959a-9ca65f32d7a3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:25.899798 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-772fa684-edd7-4f86-959a-9ca65f32d7a3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:25.906648 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-772fa684-edd7-4f86-959a-9ca65f32d7a3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:25.907098 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-772fa684-edd7-4f86-959a-9ca65f32d7a3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:25.907850 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-772fa684-edd7-4f86-959a-9ca65f32d7a3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:25.908317 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-772fa684-edd7-4f86-959a-9ca65f32d7a3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:26.044972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-772fa684-edd7-4f86-959a-9ca65f32d7a3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:26.050121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-772fa684-edd7-4f86-959a-9ca65f32d7a3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.155206 Jun 03 13:26:26.050682 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 300/543] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:25 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:26.791508 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-437bab84-5648-4741-9a7c-10dd387d87d4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:26.792205 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-437bab84-5648-4741-9a7c-10dd387d87d4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:26.798805 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-437bab84-5648-4741-9a7c-10dd387d87d4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:26.799247 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-437bab84-5648-4741-9a7c-10dd387d87d4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:26.800006 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-437bab84-5648-4741-9a7c-10dd387d87d4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:26.800467 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-437bab84-5648-4741-9a7c-10dd387d87d4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:26.918844 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-65f0f0fc-85da-4df0-a2b5-cc4cfecdd18d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3d8b4a7-d231-4088-85e9-f1e3b1bf0201"}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:26.920063 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-65f0f0fc-85da-4df0-a2b5-cc4cfecdd18d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:26.926092 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-65f0f0fc-85da-4df0-a2b5-cc4cfecdd18d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:26.926540 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-65f0f0fc-85da-4df0-a2b5-cc4cfecdd18d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:26.927307 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-65f0f0fc-85da-4df0-a2b5-cc4cfecdd18d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:26.927744 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-65f0f0fc-85da-4df0-a2b5-cc4cfecdd18d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:26.931962 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:26.936421 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-437bab84-5648-4741-9a7c-10dd387d87d4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:26.946172 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-437bab84-5648-4741-9a7c-10dd387d87d4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:26.948033 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-437bab84-5648-4741-9a7c-10dd387d87d4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:26.951719 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-437bab84-5648-4741-9a7c-10dd387d87d4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.162447 Jun 03 13:26:26.951719 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 244/544] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:26 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:27.066729 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-15cbfff6-b3f0-4dbf-b2d1-b611d4eab9b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:27.067330 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-15cbfff6-b3f0-4dbf-b2d1-b611d4eab9b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:27.073436 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-15cbfff6-b3f0-4dbf-b2d1-b611d4eab9b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:27.073872 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-15cbfff6-b3f0-4dbf-b2d1-b611d4eab9b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:27.074625 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-15cbfff6-b3f0-4dbf-b2d1-b611d4eab9b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:27.075053 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-15cbfff6-b3f0-4dbf-b2d1-b611d4eab9b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:27.203949 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-15cbfff6-b3f0-4dbf-b2d1-b611d4eab9b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:27.211720 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-15cbfff6-b3f0-4dbf-b2d1-b611d4eab9b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.148814 Jun 03 13:26:27.212312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 245/545] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:27 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:27.968549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-358083fc-69b0-4ff2-8926-60de4e582643 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:27.969261 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-358083fc-69b0-4ff2-8926-60de4e582643 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:27.975845 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-358083fc-69b0-4ff2-8926-60de4e582643 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:27.976435 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-358083fc-69b0-4ff2-8926-60de4e582643 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:27.977312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-358083fc-69b0-4ff2-8926-60de4e582643 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:27.977757 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-358083fc-69b0-4ff2-8926-60de4e582643 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:28.128297 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-358083fc-69b0-4ff2-8926-60de4e582643 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:28.128297 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-358083fc-69b0-4ff2-8926-60de4e582643 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:28.128596 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-358083fc-69b0-4ff2-8926-60de4e582643 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:28.128596 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-358083fc-69b0-4ff2-8926-60de4e582643 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.163520 Jun 03 13:26:28.128796 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 246/546] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:27 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:26:28.229027 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ab6c680d-4b3d-4e3b-bebd-f5696b6ff69d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:28.229787 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ab6c680d-4b3d-4e3b-bebd-f5696b6ff69d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:28.235791 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab6c680d-4b3d-4e3b-bebd-f5696b6ff69d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:28.236273 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab6c680d-4b3d-4e3b-bebd-f5696b6ff69d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:28.237019 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab6c680d-4b3d-4e3b-bebd-f5696b6ff69d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:28.237448 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab6c680d-4b3d-4e3b-bebd-f5696b6ff69d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:28.372892 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ab6c680d-4b3d-4e3b-bebd-f5696b6ff69d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:28.381305 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ab6c680d-4b3d-4e3b-bebd-f5696b6ff69d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.156029 Jun 03 13:26:28.381886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 247/547] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:28 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:29.146914 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0fe768bd-e5b1-431d-9aa1-543eac78539b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:29.147550 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0fe768bd-e5b1-431d-9aa1-543eac78539b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:29.149862 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:29.154950 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0fe768bd-e5b1-431d-9aa1-543eac78539b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:29.155398 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0fe768bd-e5b1-431d-9aa1-543eac78539b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:29.156176 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0fe768bd-e5b1-431d-9aa1-543eac78539b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:29.156603 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0fe768bd-e5b1-431d-9aa1-543eac78539b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:29.285854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0fe768bd-e5b1-431d-9aa1-543eac78539b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:29.295186 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0fe768bd-e5b1-431d-9aa1-543eac78539b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:29.296733 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0fe768bd-e5b1-431d-9aa1-543eac78539b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:29.297890 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0fe768bd-e5b1-431d-9aa1-543eac78539b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.154957 Jun 03 13:26:29.298445 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 248/548] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:29 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:26:29.398105 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-54cf3fb4-22cc-4b9f-beb9-fff16e4ba8fe tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:29.398717 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-54cf3fb4-22cc-4b9f-beb9-fff16e4ba8fe tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:29.406179 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-54cf3fb4-22cc-4b9f-beb9-fff16e4ba8fe tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:29.406632 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-54cf3fb4-22cc-4b9f-beb9-fff16e4ba8fe tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:29.407402 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-54cf3fb4-22cc-4b9f-beb9-fff16e4ba8fe tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:29.407838 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-54cf3fb4-22cc-4b9f-beb9-fff16e4ba8fe tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:29.541075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-54cf3fb4-22cc-4b9f-beb9-fff16e4ba8fe tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:29.549951 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-54cf3fb4-22cc-4b9f-beb9-fff16e4ba8fe tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.155554 Jun 03 13:26:29.550522 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 249/549] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:29 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:30.039947 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=4 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:30.317036 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-5d5791e9-c406-4df7-8156-7a3e742068a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:30.317559 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-5d5791e9-c406-4df7-8156-7a3e742068a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:30.324534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5d5791e9-c406-4df7-8156-7a3e742068a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:30.324992 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5d5791e9-c406-4df7-8156-7a3e742068a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:30.325777 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5d5791e9-c406-4df7-8156-7a3e742068a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:30.326212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5d5791e9-c406-4df7-8156-7a3e742068a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:30.457426 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5d5791e9-c406-4df7-8156-7a3e742068a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:30.467090 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5d5791e9-c406-4df7-8156-7a3e742068a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:30.468627 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5d5791e9-c406-4df7-8156-7a3e742068a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:30.469789 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-5d5791e9-c406-4df7-8156-7a3e742068a2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.156770 Jun 03 13:26:30.470345 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 250/550] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:30 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:26:30.567281 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ac1cf08a-cfd2-4c1d-b8a0-2101df32f3f0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:30.567804 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ac1cf08a-cfd2-4c1d-b8a0-2101df32f3f0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:30.574492 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ac1cf08a-cfd2-4c1d-b8a0-2101df32f3f0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:30.574939 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ac1cf08a-cfd2-4c1d-b8a0-2101df32f3f0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:30.575699 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ac1cf08a-cfd2-4c1d-b8a0-2101df32f3f0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:30.576134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ac1cf08a-cfd2-4c1d-b8a0-2101df32f3f0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:30.723179 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ac1cf08a-cfd2-4c1d-b8a0-2101df32f3f0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:30.723179 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ac1cf08a-cfd2-4c1d-b8a0-2101df32f3f0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1365 microversion: 2.1 time: 0.156099 Jun 03 13:26:30.723179 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 251/551] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:30 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:31.149830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-65f0f0fc-85da-4df0-a2b5-cc4cfecdd18d tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "POST /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.235351 Jun 03 13:26:31.150434 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 301/552] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:26:26 2022] POST /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments => generated 194 bytes in 4237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:26:31.487602 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8d2e94d0-1464-4807-9657-9dcbe5d5d945 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:31.488234 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8d2e94d0-1464-4807-9657-9dcbe5d5d945 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:31.495028 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8d2e94d0-1464-4807-9657-9dcbe5d5d945 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:31.495800 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8d2e94d0-1464-4807-9657-9dcbe5d5d945 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:31.496629 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8d2e94d0-1464-4807-9657-9dcbe5d5d945 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:31.497448 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8d2e94d0-1464-4807-9657-9dcbe5d5d945 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:31.503028 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=100 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:31.636399 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8d2e94d0-1464-4807-9657-9dcbe5d5d945 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:31.645730 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8d2e94d0-1464-4807-9657-9dcbe5d5d945 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:31.647235 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8d2e94d0-1464-4807-9657-9dcbe5d5d945 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:31.648433 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8d2e94d0-1464-4807-9657-9dcbe5d5d945 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.164974 Jun 03 13:26:31.648988 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 252/553] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:31 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:26:31.737345 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a11c848e-818c-4121-9eeb-05f5ca27a1f9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:31.738042 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a11c848e-818c-4121-9eeb-05f5ca27a1f9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:31.744337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a11c848e-818c-4121-9eeb-05f5ca27a1f9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:31.744797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a11c848e-818c-4121-9eeb-05f5ca27a1f9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:31.745860 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a11c848e-818c-4121-9eeb-05f5ca27a1f9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:31.746336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a11c848e-818c-4121-9eeb-05f5ca27a1f9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:31.890097 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a11c848e-818c-4121-9eeb-05f5ca27a1f9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:31.898191 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a11c848e-818c-4121-9eeb-05f5ca27a1f9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1555 microversion: 2.1 time: 0.165473 Jun 03 13:26:31.898754 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 302/554] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:31 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:31.915422 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b653d06d-c657-48dc-a278-b26fc0894f2e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:31.915910 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b653d06d-c657-48dc-a278-b26fc0894f2e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:31.922319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b653d06d-c657-48dc-a278-b26fc0894f2e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:31.922763 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b653d06d-c657-48dc-a278-b26fc0894f2e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:31.923520 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b653d06d-c657-48dc-a278-b26fc0894f2e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:31.923951 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b653d06d-c657-48dc-a278-b26fc0894f2e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:32.015493 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b653d06d-c657-48dc-a278-b26fc0894f2e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103991 Jun 03 13:26:32.016105 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 253/555] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 13:26:31 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:26:32.667349 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-bbf0d44a-bad5-491b-9172-6a863c3e9186 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:32.667972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-bbf0d44a-bad5-491b-9172-6a863c3e9186 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:32.674350 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bbf0d44a-bad5-491b-9172-6a863c3e9186 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:32.674791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bbf0d44a-bad5-491b-9172-6a863c3e9186 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:32.675546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bbf0d44a-bad5-491b-9172-6a863c3e9186 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:32.675970 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bbf0d44a-bad5-491b-9172-6a863c3e9186 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:32.903957 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-bbf0d44a-bad5-491b-9172-6a863c3e9186 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:32.914813 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-bbf0d44a-bad5-491b-9172-6a863c3e9186 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:32.916367 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-bbf0d44a-bad5-491b-9172-6a863c3e9186 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:32.918491 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-bbf0d44a-bad5-491b-9172-6a863c3e9186 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.255347 Jun 03 13:26:32.919268 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 303/556] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:32 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:33.061460 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-3e3ed79d-24ea-4a23-9261-0210fd0e97b2 req-99d06984-e326-4f60-b99a-63cea6086b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c95a8052-ebb8-4326-83e4-85340beb68e7", "tag": "20ec12a9-5558-4ed8-a89c-b0b033b62225"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:33.069977 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-3e3ed79d-24ea-4a23-9261-0210fd0e97b2 req-99d06984-e326-4f60-b99a-63cea6086b38 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:33.070511 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-3e3ed79d-24ea-4a23-9261-0210fd0e97b2 req-99d06984-e326-4f60-b99a-63cea6086b38 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:33.083552 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-3e3ed79d-24ea-4a23-9261-0210fd0e97b2 req-99d06984-e326-4f60-b99a-63cea6086b38 service nova] Creating event network-changed:20ec12a9-5558-4ed8-a89c-b0b033b62225 for instance c95a8052-ebb8-4326-83e4-85340beb68e7 on hv-cinder-80135 Jun 03 13:26:33.088616 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-3e3ed79d-24ea-4a23-9261-0210fd0e97b2 req-99d06984-e326-4f60-b99a-63cea6086b38 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031963 Jun 03 13:26:33.089889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 254/557] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:26:33.938890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-55649540-478a-4b2b-9275-cf22c1e88a71 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:33.939598 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-55649540-478a-4b2b-9275-cf22c1e88a71 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:33.949568 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-55649540-478a-4b2b-9275-cf22c1e88a71 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:33.950017 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-55649540-478a-4b2b-9275-cf22c1e88a71 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:33.950782 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-55649540-478a-4b2b-9275-cf22c1e88a71 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:33.951387 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-55649540-478a-4b2b-9275-cf22c1e88a71 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:34.110977 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-55649540-478a-4b2b-9275-cf22c1e88a71 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:34.119828 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-55649540-478a-4b2b-9275-cf22c1e88a71 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:34.122355 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-55649540-478a-4b2b-9275-cf22c1e88a71 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:34.123525 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-55649540-478a-4b2b-9275-cf22c1e88a71 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.188869 Jun 03 13:26:34.124291 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 304/558] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:33 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:35.146112 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-01f70f82-8c31-40f5-bd0e-2773cb101048 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:35.146816 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-01f70f82-8c31-40f5-bd0e-2773cb101048 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:35.153324 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-01f70f82-8c31-40f5-bd0e-2773cb101048 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:35.162622 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-01f70f82-8c31-40f5-bd0e-2773cb101048 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:35.162622 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-01f70f82-8c31-40f5-bd0e-2773cb101048 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:35.162622 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-01f70f82-8c31-40f5-bd0e-2773cb101048 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:35.287003 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-01f70f82-8c31-40f5-bd0e-2773cb101048 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:35.296589 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-01f70f82-8c31-40f5-bd0e-2773cb101048 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:35.298093 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-01f70f82-8c31-40f5-bd0e-2773cb101048 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:35.299252 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-01f70f82-8c31-40f5-bd0e-2773cb101048 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.159123 Jun 03 13:26:35.299815 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 255/559] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:35 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:36.317535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f6d788ca-1282-4618-9c72-4401c8c5bb50 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:36.318069 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f6d788ca-1282-4618-9c72-4401c8c5bb50 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:36.325188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f6d788ca-1282-4618-9c72-4401c8c5bb50 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:36.325626 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f6d788ca-1282-4618-9c72-4401c8c5bb50 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:36.326373 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f6d788ca-1282-4618-9c72-4401c8c5bb50 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:36.326833 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f6d788ca-1282-4618-9c72-4401c8c5bb50 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:36.452977 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f6d788ca-1282-4618-9c72-4401c8c5bb50 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:36.461422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f6d788ca-1282-4618-9c72-4401c8c5bb50 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:36.462924 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f6d788ca-1282-4618-9c72-4401c8c5bb50 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:36.464117 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f6d788ca-1282-4618-9c72-4401c8c5bb50 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.150508 Jun 03 13:26:36.464702 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 305/560] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:36 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:37.482964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d2504e92-30a4-49cc-8bfd-a8b33f7ee166 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:37.483977 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d2504e92-30a4-49cc-8bfd-a8b33f7ee166 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:37.490000 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d2504e92-30a4-49cc-8bfd-a8b33f7ee166 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:37.495636 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d2504e92-30a4-49cc-8bfd-a8b33f7ee166 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:37.495636 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d2504e92-30a4-49cc-8bfd-a8b33f7ee166 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:37.495636 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d2504e92-30a4-49cc-8bfd-a8b33f7ee166 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:37.627167 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d2504e92-30a4-49cc-8bfd-a8b33f7ee166 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:37.635595 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d2504e92-30a4-49cc-8bfd-a8b33f7ee166 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:37.639996 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d2504e92-30a4-49cc-8bfd-a8b33f7ee166 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:37.639996 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d2504e92-30a4-49cc-8bfd-a8b33f7ee166 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.160435 Jun 03 13:26:37.639996 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 256/561] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:37 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:38.657295 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-18871ded-7ed3-42f7-bd1f-23aacdb4dff1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:38.657892 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-18871ded-7ed3-42f7-bd1f-23aacdb4dff1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:38.665301 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-18871ded-7ed3-42f7-bd1f-23aacdb4dff1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:38.665741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-18871ded-7ed3-42f7-bd1f-23aacdb4dff1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:38.666484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-18871ded-7ed3-42f7-bd1f-23aacdb4dff1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:38.667480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-18871ded-7ed3-42f7-bd1f-23aacdb4dff1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:38.798634 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-18871ded-7ed3-42f7-bd1f-23aacdb4dff1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:38.809210 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-18871ded-7ed3-42f7-bd1f-23aacdb4dff1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:38.809210 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-18871ded-7ed3-42f7-bd1f-23aacdb4dff1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:38.810038 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-18871ded-7ed3-42f7-bd1f-23aacdb4dff1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.156693 Jun 03 13:26:38.810611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 306/562] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:38 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:39.723889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1bae33a0-29ae-4693-a0f1-5690e2d993e3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:39.728458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-1bae33a0-29ae-4693-a0f1-5690e2d993e3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:39.732821 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1bae33a0-29ae-4693-a0f1-5690e2d993e3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:39.733280 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1bae33a0-29ae-4693-a0f1-5690e2d993e3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:39.734524 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1bae33a0-29ae-4693-a0f1-5690e2d993e3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:39.734973 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1bae33a0-29ae-4693-a0f1-5690e2d993e3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:39.759468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-1bae33a0-29ae-4693-a0f1-5690e2d993e3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lazy-loading 'flavor' on Instance uuid 5852e29d-4480-4e14-9e17-d4cccdcb7d1a {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:26:39.828586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3523c2d1-1aa2-42e0-8477-562d4c8f0308 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:39.833259 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3523c2d1-1aa2-42e0-8477-562d4c8f0308 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:39.836112 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3523c2d1-1aa2-42e0-8477-562d4c8f0308 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:39.836597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3523c2d1-1aa2-42e0-8477-562d4c8f0308 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:39.837367 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3523c2d1-1aa2-42e0-8477-562d4c8f0308 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:39.837807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3523c2d1-1aa2-42e0-8477-562d4c8f0308 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:39.970850 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3523c2d1-1aa2-42e0-8477-562d4c8f0308 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:39.979697 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3523c2d1-1aa2-42e0-8477-562d4c8f0308 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:39.981407 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3523c2d1-1aa2-42e0-8477-562d4c8f0308 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:39.982569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3523c2d1-1aa2-42e0-8477-562d4c8f0308 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.157847 Jun 03 13:26:39.983182 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 307/563] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:39 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:40.081249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-1bae33a0-29ae-4693-a0f1-5690e2d993e3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "POST /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/action" status: 200 len: 32 microversion: 2.1 time: 0.361506 Jun 03 13:26:40.081820 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 257/564] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:26:39 2022] POST /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:26:40.091136 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-002ec317-d157-4370-8e6e-794cff04724b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:40.091750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-002ec317-d157-4370-8e6e-794cff04724b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:40.097862 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-002ec317-d157-4370-8e6e-794cff04724b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:40.098309 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-002ec317-d157-4370-8e6e-794cff04724b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:40.099154 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-002ec317-d157-4370-8e6e-794cff04724b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:40.099597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-002ec317-d157-4370-8e6e-794cff04724b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:40.227499 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-002ec317-d157-4370-8e6e-794cff04724b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:40.235427 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-002ec317-d157-4370-8e6e-794cff04724b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.148541 Jun 03 13:26:40.236237 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 308/565] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:40 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:40.619405 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-cb3d63a5-91c1-4258-b9aa-8fc1d88825fd req-fd32f2f1-ab00-4eff-abb3-e9e2f363197b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f119f5f-b6ed-45a0-a780-b1e037c96cc1", "name": "network-vif-plugged", "status": "completed", "tag": "14995843-d975-4a00-9ad9-746c61f720d5"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:40.629329 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-cb3d63a5-91c1-4258-b9aa-8fc1d88825fd req-fd32f2f1-ab00-4eff-abb3-e9e2f363197b service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:40.629770 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-cb3d63a5-91c1-4258-b9aa-8fc1d88825fd req-fd32f2f1-ab00-4eff-abb3-e9e2f363197b service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:40.642191 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-cb3d63a5-91c1-4258-b9aa-8fc1d88825fd req-fd32f2f1-ab00-4eff-abb3-e9e2f363197b service nova] Creating event network-vif-plugged:14995843-d975-4a00-9ad9-746c61f720d5 for instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 on hv-cinder-80135 Jun 03 13:26:40.648051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-cb3d63a5-91c1-4258-b9aa-8fc1d88825fd req-fd32f2f1-ab00-4eff-abb3-e9e2f363197b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032270 Jun 03 13:26:40.648716 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 258/566] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:26:41.001888 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-cf6c4207-212e-4695-8c52-9de99106f737 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:41.002635 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-cf6c4207-212e-4695-8c52-9de99106f737 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:41.009149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cf6c4207-212e-4695-8c52-9de99106f737 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:41.009579 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cf6c4207-212e-4695-8c52-9de99106f737 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:41.014789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cf6c4207-212e-4695-8c52-9de99106f737 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:41.014789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cf6c4207-212e-4695-8c52-9de99106f737 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:41.140500 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cf6c4207-212e-4695-8c52-9de99106f737 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:41.148950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cf6c4207-212e-4695-8c52-9de99106f737 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:41.150462 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cf6c4207-212e-4695-8c52-9de99106f737 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:41.151952 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-cf6c4207-212e-4695-8c52-9de99106f737 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.154548 Jun 03 13:26:41.152551 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 309/567] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:40 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:41.254718 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e3bd6957-b60c-467b-a18f-f20cbd213b39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:41.255325 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e3bd6957-b60c-467b-a18f-f20cbd213b39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:41.262949 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e3bd6957-b60c-467b-a18f-f20cbd213b39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:41.263371 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e3bd6957-b60c-467b-a18f-f20cbd213b39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:41.264126 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e3bd6957-b60c-467b-a18f-f20cbd213b39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:41.264579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e3bd6957-b60c-467b-a18f-f20cbd213b39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:41.403380 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e3bd6957-b60c-467b-a18f-f20cbd213b39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:41.411330 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e3bd6957-b60c-467b-a18f-f20cbd213b39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.160872 Jun 03 13:26:41.411889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 259/568] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:41 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:42.170654 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-515b1bb6-a8b4-4641-a0fe-f55817c17b2b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:42.171261 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-515b1bb6-a8b4-4641-a0fe-f55817c17b2b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:42.177682 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-515b1bb6-a8b4-4641-a0fe-f55817c17b2b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:42.178132 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-515b1bb6-a8b4-4641-a0fe-f55817c17b2b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:42.178892 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-515b1bb6-a8b4-4641-a0fe-f55817c17b2b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:42.179325 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-515b1bb6-a8b4-4641-a0fe-f55817c17b2b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:42.309297 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-515b1bb6-a8b4-4641-a0fe-f55817c17b2b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:42.317753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-515b1bb6-a8b4-4641-a0fe-f55817c17b2b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:42.319266 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-515b1bb6-a8b4-4641-a0fe-f55817c17b2b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:42.320436 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-515b1bb6-a8b4-4641-a0fe-f55817c17b2b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.153770 Jun 03 13:26:42.320989 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 310/569] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:42 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:42.428920 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-587ac6a5-eb3b-41b6-bdcd-1c71c2313d96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:42.429522 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-587ac6a5-eb3b-41b6-bdcd-1c71c2313d96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:42.437233 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-587ac6a5-eb3b-41b6-bdcd-1c71c2313d96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:42.437679 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-587ac6a5-eb3b-41b6-bdcd-1c71c2313d96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:42.438434 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-587ac6a5-eb3b-41b6-bdcd-1c71c2313d96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:42.438869 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-587ac6a5-eb3b-41b6-bdcd-1c71c2313d96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:42.571496 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-587ac6a5-eb3b-41b6-bdcd-1c71c2313d96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:42.579551 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-587ac6a5-eb3b-41b6-bdcd-1c71c2313d96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.154797 Jun 03 13:26:42.580110 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 260/570] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:42 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:43.339466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-fb47a370-cce3-4889-b6e2-7433f9ed9f34 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:43.340108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-fb47a370-cce3-4889-b6e2-7433f9ed9f34 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:43.346543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fb47a370-cce3-4889-b6e2-7433f9ed9f34 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:43.346992 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fb47a370-cce3-4889-b6e2-7433f9ed9f34 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:43.347754 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fb47a370-cce3-4889-b6e2-7433f9ed9f34 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:43.348211 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fb47a370-cce3-4889-b6e2-7433f9ed9f34 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:43.577294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fb47a370-cce3-4889-b6e2-7433f9ed9f34 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:43.587009 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fb47a370-cce3-4889-b6e2-7433f9ed9f34 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:43.589304 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fb47a370-cce3-4889-b6e2-7433f9ed9f34 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:43.590686 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-fb47a370-cce3-4889-b6e2-7433f9ed9f34 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.255776 Jun 03 13:26:43.591402 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 311/571] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:43 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:43.596826 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8a2f2270-605c-46f5-851d-8908c72d8bb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:43.604872 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8a2f2270-605c-46f5-851d-8908c72d8bb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:43.604872 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8a2f2270-605c-46f5-851d-8908c72d8bb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:43.604872 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8a2f2270-605c-46f5-851d-8908c72d8bb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:43.605520 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8a2f2270-605c-46f5-851d-8908c72d8bb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:43.605962 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8a2f2270-605c-46f5-851d-8908c72d8bb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:43.791471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8a2f2270-605c-46f5-851d-8908c72d8bb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:43.800296 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8a2f2270-605c-46f5-851d-8908c72d8bb0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.207186 Jun 03 13:26:43.801154 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 261/572] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:43 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:44.621276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4728d098-fe88-4d2b-9898-007838538a96 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:44.621827 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4728d098-fe88-4d2b-9898-007838538a96 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:44.628965 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4728d098-fe88-4d2b-9898-007838538a96 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:44.629406 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4728d098-fe88-4d2b-9898-007838538a96 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:44.630213 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4728d098-fe88-4d2b-9898-007838538a96 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:44.630577 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4728d098-fe88-4d2b-9898-007838538a96 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:44.763467 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4728d098-fe88-4d2b-9898-007838538a96 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:44.772423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4728d098-fe88-4d2b-9898-007838538a96 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:44.774096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4728d098-fe88-4d2b-9898-007838538a96 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:44.775452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4728d098-fe88-4d2b-9898-007838538a96 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.158101 Jun 03 13:26:44.776524 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 312/573] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:44 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:44.819370 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b3e45729-06b7-4590-a062-d392d46ad201 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:44.820112 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b3e45729-06b7-4590-a062-d392d46ad201 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:44.827581 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b3e45729-06b7-4590-a062-d392d46ad201 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:44.828025 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b3e45729-06b7-4590-a062-d392d46ad201 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:44.828858 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b3e45729-06b7-4590-a062-d392d46ad201 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:44.829288 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b3e45729-06b7-4590-a062-d392d46ad201 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:44.962738 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b3e45729-06b7-4590-a062-d392d46ad201 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:44.971089 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b3e45729-06b7-4590-a062-d392d46ad201 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.155735 Jun 03 13:26:44.971654 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 262/574] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:44 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:45.794183 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ca099931-0388-478d-9f9e-6fb0c1012a4d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:45.794722 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ca099931-0388-478d-9f9e-6fb0c1012a4d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:45.801284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ca099931-0388-478d-9f9e-6fb0c1012a4d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:45.801733 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ca099931-0388-478d-9f9e-6fb0c1012a4d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:45.802488 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ca099931-0388-478d-9f9e-6fb0c1012a4d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:45.802924 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ca099931-0388-478d-9f9e-6fb0c1012a4d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:45.929022 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ca099931-0388-478d-9f9e-6fb0c1012a4d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:45.937699 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ca099931-0388-478d-9f9e-6fb0c1012a4d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:45.939214 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ca099931-0388-478d-9f9e-6fb0c1012a4d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:45.940399 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ca099931-0388-478d-9f9e-6fb0c1012a4d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1811 microversion: 2.20 time: 0.150779 Jun 03 13:26:45.940956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 313/575] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:45 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1811 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:45.988341 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-247ae87d-b991-45b5-8e8e-d79bd9748f1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:45.988968 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-247ae87d-b991-45b5-8e8e-d79bd9748f1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:45.995557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-247ae87d-b991-45b5-8e8e-d79bd9748f1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:45.996002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-247ae87d-b991-45b5-8e8e-d79bd9748f1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:45.996817 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-247ae87d-b991-45b5-8e8e-d79bd9748f1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:45.997518 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-247ae87d-b991-45b5-8e8e-d79bd9748f1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:46.131262 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-247ae87d-b991-45b5-8e8e-d79bd9748f1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:46.139763 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-247ae87d-b991-45b5-8e8e-d79bd9748f1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.155343 Jun 03 13:26:46.140349 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 263/576] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:45 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:46.959291 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7f10be53-4985-4bd2-8bcc-0cf49485a72b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:46.959917 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7f10be53-4985-4bd2-8bcc-0cf49485a72b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:46.967124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7f10be53-4985-4bd2-8bcc-0cf49485a72b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:46.967556 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7f10be53-4985-4bd2-8bcc-0cf49485a72b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:46.969079 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7f10be53-4985-4bd2-8bcc-0cf49485a72b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:46.969541 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7f10be53-4985-4bd2-8bcc-0cf49485a72b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:47.110401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7f10be53-4985-4bd2-8bcc-0cf49485a72b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:47.118801 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7f10be53-4985-4bd2-8bcc-0cf49485a72b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:47.120939 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7f10be53-4985-4bd2-8bcc-0cf49485a72b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:47.122090 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7f10be53-4985-4bd2-8bcc-0cf49485a72b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1798 microversion: 2.20 time: 0.166914 Jun 03 13:26:47.122902 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 314/577] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:26:46 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1798 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:26:47.156428 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e7529412-52d0-4caa-86e7-345206634a75 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:47.157047 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e7529412-52d0-4caa-86e7-345206634a75 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:47.163429 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e7529412-52d0-4caa-86e7-345206634a75 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:47.163878 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e7529412-52d0-4caa-86e7-345206634a75 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:47.164664 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e7529412-52d0-4caa-86e7-345206634a75 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:47.165104 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e7529412-52d0-4caa-86e7-345206634a75 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:47.290833 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e7529412-52d0-4caa-86e7-345206634a75 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:47.299432 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e7529412-52d0-4caa-86e7-345206634a75 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.146860 Jun 03 13:26:47.299991 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 264/578] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:47 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:48.316923 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-38c42fba-9c23-44cd-af92-d6442ca32ecf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:48.317531 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-38c42fba-9c23-44cd-af92-d6442ca32ecf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:48.325653 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-38c42fba-9c23-44cd-af92-d6442ca32ecf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:48.326099 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-38c42fba-9c23-44cd-af92-d6442ca32ecf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:48.326862 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-38c42fba-9c23-44cd-af92-d6442ca32ecf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:48.327295 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-38c42fba-9c23-44cd-af92-d6442ca32ecf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:48.454332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-38c42fba-9c23-44cd-af92-d6442ca32ecf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:48.462097 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-38c42fba-9c23-44cd-af92-d6442ca32ecf tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.149264 Jun 03 13:26:48.462660 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 315/579] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:48 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:49.480374 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4139997d-7e12-4a93-aa16-b8a9a0b4daf9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:49.480992 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4139997d-7e12-4a93-aa16-b8a9a0b4daf9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:49.487487 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4139997d-7e12-4a93-aa16-b8a9a0b4daf9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:49.487944 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4139997d-7e12-4a93-aa16-b8a9a0b4daf9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:49.488906 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4139997d-7e12-4a93-aa16-b8a9a0b4daf9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:49.489215 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4139997d-7e12-4a93-aa16-b8a9a0b4daf9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:49.625176 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4139997d-7e12-4a93-aa16-b8a9a0b4daf9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:49.633012 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4139997d-7e12-4a93-aa16-b8a9a0b4daf9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.157230 Jun 03 13:26:49.633568 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 265/580] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:49 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:49.855634 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1651405690", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-453693398", "security_groups": [{"name": "tempest-secgroup-smoke-921469941"}], "block_device_mapping_v2": [{"uuid": "b38d166f-7a63-4aa5-9158-806eedcfc538", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2487575-f377-4558-bc42-3d6e3c396511"}]}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:49.969607 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] validate_networks() for [('f2487575-f377-4558-bc42-3d6e3c396511', None, None, None, None, None)] {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:26:50.366378 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:26:50.366803 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:26:50.367283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:26:50.367699 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:26:50.368110 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:26:50.378134 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:50.378585 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:50.379384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:50.379824 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:50.396899 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Getting quotas for project c880a17cc9844081bee38006d5b92f86. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:26:50.400881 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Getting quotas for user 77c56945d1d74a1eaa5e0c8f9e43f086 and project c880a17cc9844081bee38006d5b92f86. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:26:50.457762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:26:50.459875 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b38d166f-7a63-4aa5-9158-806eedcfc538',volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:26:50.649742 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-699838d6-4300-44ad-b3b9-5d1274a37cbb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:50.650298 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-699838d6-4300-44ad-b3b9-5d1274a37cbb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:50.656927 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-699838d6-4300-44ad-b3b9-5d1274a37cbb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:50.657375 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-699838d6-4300-44ad-b3b9-5d1274a37cbb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:50.658128 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-699838d6-4300-44ad-b3b9-5d1274a37cbb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:50.658558 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-699838d6-4300-44ad-b3b9-5d1274a37cbb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:50.792446 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-699838d6-4300-44ad-b3b9-5d1274a37cbb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:50.800400 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-699838d6-4300-44ad-b3b9-5d1274a37cbb tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.154487 Jun 03 13:26:50.800999 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 266/581] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:50 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:50.824653 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-40595fb7-cb3d-4bdf-81a0-ba392c0e90ac tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.973168 Jun 03 13:26:50.825624 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 316/582] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:26:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:26:50.835358 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d4f0bd52-25c3-46e3-beec-3de44ff6a961 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:50.835973 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d4f0bd52-25c3-46e3-beec-3de44ff6a961 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:50.890195 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d4f0bd52-25c3-46e3-beec-3de44ff6a961 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:50.897160 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d4f0bd52-25c3-46e3-beec-3de44ff6a961 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1094 microversion: 2.1 time: 0.065727 Jun 03 13:26:50.897719 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 267/583] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:50 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:51.818273 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-928117f8-5c99-4631-adb9-711213dc6ba0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:51.818883 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-928117f8-5c99-4631-adb9-711213dc6ba0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:51.825452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-928117f8-5c99-4631-adb9-711213dc6ba0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:51.826016 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-928117f8-5c99-4631-adb9-711213dc6ba0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:51.826655 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-928117f8-5c99-4631-adb9-711213dc6ba0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:51.827093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-928117f8-5c99-4631-adb9-711213dc6ba0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:51.829816 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:51.914346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-269be879-c307-438a-b206-803af89c952a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:51.914958 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-269be879-c307-438a-b206-803af89c952a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:51.922086 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-269be879-c307-438a-b206-803af89c952a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:51.922534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-269be879-c307-438a-b206-803af89c952a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:51.923527 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-269be879-c307-438a-b206-803af89c952a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:51.923981 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-269be879-c307-438a-b206-803af89c952a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:51.964981 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-928117f8-5c99-4631-adb9-711213dc6ba0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:51.974182 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-928117f8-5c99-4631-adb9-711213dc6ba0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.160241 Jun 03 13:26:51.974750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 317/584] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:51 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:51.989864 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-269be879-c307-438a-b206-803af89c952a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:51.998662 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-269be879-c307-438a-b206-803af89c952a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1144 microversion: 2.1 time: 0.087984 Jun 03 13:26:51.999371 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 268/585] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:51 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:52.992382 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-adc88368-2b40-4bba-bf87-1da3381ce806 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:52.993061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-adc88368-2b40-4bba-bf87-1da3381ce806 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:53.002187 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-adc88368-2b40-4bba-bf87-1da3381ce806 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:53.002683 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-adc88368-2b40-4bba-bf87-1da3381ce806 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:53.009582 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-adc88368-2b40-4bba-bf87-1da3381ce806 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:53.009582 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-adc88368-2b40-4bba-bf87-1da3381ce806 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:53.015741 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9dd574a6-e391-4e9d-9a0b-8dfc7eb9fe64 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:53.016370 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-9dd574a6-e391-4e9d-9a0b-8dfc7eb9fe64 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:53.023244 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9dd574a6-e391-4e9d-9a0b-8dfc7eb9fe64 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:53.023819 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9dd574a6-e391-4e9d-9a0b-8dfc7eb9fe64 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:53.024724 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9dd574a6-e391-4e9d-9a0b-8dfc7eb9fe64 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:53.025463 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9dd574a6-e391-4e9d-9a0b-8dfc7eb9fe64 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:53.047755 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:53.132549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9dd574a6-e391-4e9d-9a0b-8dfc7eb9fe64 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:53.140791 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9dd574a6-e391-4e9d-9a0b-8dfc7eb9fe64 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1200 microversion: 2.1 time: 0.128897 Jun 03 13:26:53.144392 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 269/586] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:53 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1200 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:53.155973 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-adc88368-2b40-4bba-bf87-1da3381ce806 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:53.164457 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-adc88368-2b40-4bba-bf87-1da3381ce806 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.176585 Jun 03 13:26:53.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 318/587] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:52 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:54.160760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-fe9eb6d2-192d-4feb-a27d-3c777975b2a5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:54.161368 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-fe9eb6d2-192d-4feb-a27d-3c777975b2a5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:54.169202 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fe9eb6d2-192d-4feb-a27d-3c777975b2a5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:54.169646 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fe9eb6d2-192d-4feb-a27d-3c777975b2a5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:54.170408 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fe9eb6d2-192d-4feb-a27d-3c777975b2a5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:54.170840 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fe9eb6d2-192d-4feb-a27d-3c777975b2a5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:54.182776 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-47676dca-0b7c-4f5a-b653-876986ab0a1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:54.183543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-47676dca-0b7c-4f5a-b653-876986ab0a1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:54.190657 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47676dca-0b7c-4f5a-b653-876986ab0a1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:54.191361 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47676dca-0b7c-4f5a-b653-876986ab0a1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:54.192121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47676dca-0b7c-4f5a-b653-876986ab0a1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:54.192577 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47676dca-0b7c-4f5a-b653-876986ab0a1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:54.323841 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-fe9eb6d2-192d-4feb-a27d-3c777975b2a5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:54.326919 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-47676dca-0b7c-4f5a-b653-876986ab0a1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:54.331791 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-fe9eb6d2-192d-4feb-a27d-3c777975b2a5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1277 microversion: 2.1 time: 0.174842 Jun 03 13:26:54.332709 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 270/588] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:54 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:54.335722 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-47676dca-0b7c-4f5a-b653-876986ab0a1e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.157518 Jun 03 13:26:54.336471 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 319/589] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:54 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:54.755067 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-b3bc1a92-b890-47cc-ae32-9f61f4f3e2dd req-9ed89a9f-8c45-4d66-b352-5251ca768c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948a342e-2849-416a-a15b-86ca72bb08d7", "tag": "36459da4-523e-4b02-9ab9-8cf2c08ac474"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:54.765449 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-b3bc1a92-b890-47cc-ae32-9f61f4f3e2dd req-9ed89a9f-8c45-4d66-b352-5251ca768c43 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:54.766271 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-b3bc1a92-b890-47cc-ae32-9f61f4f3e2dd req-9ed89a9f-8c45-4d66-b352-5251ca768c43 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:54.785695 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-b3bc1a92-b890-47cc-ae32-9f61f4f3e2dd req-9ed89a9f-8c45-4d66-b352-5251ca768c43 service nova] Creating event network-changed:36459da4-523e-4b02-9ab9-8cf2c08ac474 for instance 948a342e-2849-416a-a15b-86ca72bb08d7 on hv-cinder-80135 Jun 03 13:26:54.792922 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-b3bc1a92-b890-47cc-ae32-9f61f4f3e2dd req-9ed89a9f-8c45-4d66-b352-5251ca768c43 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040992 Jun 03 13:26:54.793952 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 271/590] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:26:55.349848 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-326ca679-bef8-4aaa-964f-4ea7036e0253 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:55.350464 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-326ca679-bef8-4aaa-964f-4ea7036e0253 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:55.353282 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-25f8d891-e06a-4d5e-b539-d8eb671edd65 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:55.354814 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-25f8d891-e06a-4d5e-b539-d8eb671edd65 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:55.358556 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-326ca679-bef8-4aaa-964f-4ea7036e0253 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:55.359015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-326ca679-bef8-4aaa-964f-4ea7036e0253 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:55.359810 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-326ca679-bef8-4aaa-964f-4ea7036e0253 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:55.360292 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-326ca679-bef8-4aaa-964f-4ea7036e0253 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:55.361909 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-25f8d891-e06a-4d5e-b539-d8eb671edd65 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:55.362364 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-25f8d891-e06a-4d5e-b539-d8eb671edd65 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:55.363125 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-25f8d891-e06a-4d5e-b539-d8eb671edd65 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:55.363557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-25f8d891-e06a-4d5e-b539-d8eb671edd65 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:55.500644 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-326ca679-bef8-4aaa-964f-4ea7036e0253 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:55.508507 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-326ca679-bef8-4aaa-964f-4ea7036e0253 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.162506 Jun 03 13:26:55.509086 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 320/591] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:55 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:55.577056 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-25f8d891-e06a-4d5e-b539-d8eb671edd65 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:55.585217 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-25f8d891-e06a-4d5e-b539-d8eb671edd65 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.235980 Jun 03 13:26:55.585875 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 272/592] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:55 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:56.525454 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-64c6dd9b-2dc4-47ab-b136-8ac02475db4e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:56.526074 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-64c6dd9b-2dc4-47ab-b136-8ac02475db4e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:56.528727 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:56.533516 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-64c6dd9b-2dc4-47ab-b136-8ac02475db4e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:56.533971 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-64c6dd9b-2dc4-47ab-b136-8ac02475db4e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:56.534736 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-64c6dd9b-2dc4-47ab-b136-8ac02475db4e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:56.535177 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-64c6dd9b-2dc4-47ab-b136-8ac02475db4e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:56.602568 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7e7728d3-8b19-4919-a6ac-63d1d25112db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:56.603184 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-7e7728d3-8b19-4919-a6ac-63d1d25112db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:56.609769 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7e7728d3-8b19-4919-a6ac-63d1d25112db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:56.610482 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7e7728d3-8b19-4919-a6ac-63d1d25112db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:56.610970 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7e7728d3-8b19-4919-a6ac-63d1d25112db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:56.611404 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7e7728d3-8b19-4919-a6ac-63d1d25112db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:56.663598 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-64c6dd9b-2dc4-47ab-b136-8ac02475db4e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:56.671293 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-64c6dd9b-2dc4-47ab-b136-8ac02475db4e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.149690 Jun 03 13:26:56.671856 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 321/593] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:56 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:56.740766 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-7e7728d3-8b19-4919-a6ac-63d1d25112db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:56.749810 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-7e7728d3-8b19-4919-a6ac-63d1d25112db tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.151144 Jun 03 13:26:56.750398 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 273/594] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:56 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:57.688534 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f9b0d6b6-e72e-4fdb-9a17-e5305a54614f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:57.689181 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f9b0d6b6-e72e-4fdb-9a17-e5305a54614f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:57.695469 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f9b0d6b6-e72e-4fdb-9a17-e5305a54614f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:57.695863 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f9b0d6b6-e72e-4fdb-9a17-e5305a54614f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:57.696659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f9b0d6b6-e72e-4fdb-9a17-e5305a54614f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:57.697102 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f9b0d6b6-e72e-4fdb-9a17-e5305a54614f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:57.766772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4f20a3df-ee6b-44ad-bcf5-6a166b7e2ce4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:57.767388 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4f20a3df-ee6b-44ad-bcf5-6a166b7e2ce4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:57.773827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4f20a3df-ee6b-44ad-bcf5-6a166b7e2ce4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:57.774443 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4f20a3df-ee6b-44ad-bcf5-6a166b7e2ce4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:57.775070 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4f20a3df-ee6b-44ad-bcf5-6a166b7e2ce4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:57.775503 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4f20a3df-ee6b-44ad-bcf5-6a166b7e2ce4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:57.911930 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4f20a3df-ee6b-44ad-bcf5-6a166b7e2ce4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:57.921215 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4f20a3df-ee6b-44ad-bcf5-6a166b7e2ce4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.158200 Jun 03 13:26:57.921919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 274/595] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:57 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:26:58.061552 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f9b0d6b6-e72e-4fdb-9a17-e5305a54614f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:58.069014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f9b0d6b6-e72e-4fdb-9a17-e5305a54614f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.384310 Jun 03 13:26:58.069577 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 322/596] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:57 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:58.939339 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-408ed0f7-44f3-4cfb-a4c7-7f656bb04c76 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:58.939925 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-408ed0f7-44f3-4cfb-a4c7-7f656bb04c76 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:58.946503 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-408ed0f7-44f3-4cfb-a4c7-7f656bb04c76 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:58.948603 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-408ed0f7-44f3-4cfb-a4c7-7f656bb04c76 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:58.948603 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-408ed0f7-44f3-4cfb-a4c7-7f656bb04c76 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:58.948603 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-408ed0f7-44f3-4cfb-a4c7-7f656bb04c76 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:59.079646 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-408ed0f7-44f3-4cfb-a4c7-7f656bb04c76 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:59.086461 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f3277894-a01b-4ea5-b09c-0997b891b5a9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:26:59.087067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f3277894-a01b-4ea5-b09c-0997b891b5a9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:26:59.087693 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-408ed0f7-44f3-4cfb-a4c7-7f656bb04c76 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.152168 Jun 03 13:26:59.088508 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 275/597] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:58 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:59.093181 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f3277894-a01b-4ea5-b09c-0997b891b5a9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:59.093628 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f3277894-a01b-4ea5-b09c-0997b891b5a9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:59.094378 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f3277894-a01b-4ea5-b09c-0997b891b5a9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:59.094808 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f3277894-a01b-4ea5-b09c-0997b891b5a9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:59.222214 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f3277894-a01b-4ea5-b09c-0997b891b5a9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:26:59.231962 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f3277894-a01b-4ea5-b09c-0997b891b5a9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.149153 Jun 03 13:26:59.235307 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 323/598] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:26:59 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:00.105407 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6896e71b-fa78-4407-b3f5-51cb3aa3533c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:00.106013 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6896e71b-fa78-4407-b3f5-51cb3aa3533c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:00.108433 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=58 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:00.113121 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6896e71b-fa78-4407-b3f5-51cb3aa3533c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:00.113571 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6896e71b-fa78-4407-b3f5-51cb3aa3533c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:00.114336 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6896e71b-fa78-4407-b3f5-51cb3aa3533c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:00.114779 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6896e71b-fa78-4407-b3f5-51cb3aa3533c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:00.244212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6896e71b-fa78-4407-b3f5-51cb3aa3533c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:00.249432 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-64f3cc13-1581-40ea-a121-8efd603497e9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:00.250039 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-64f3cc13-1581-40ea-a121-8efd603497e9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:00.253370 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6896e71b-fa78-4407-b3f5-51cb3aa3533c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.151706 Jun 03 13:27:00.253879 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 276/599] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:00 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:00.256394 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-64f3cc13-1581-40ea-a121-8efd603497e9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:00.256875 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-64f3cc13-1581-40ea-a121-8efd603497e9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:00.257632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-64f3cc13-1581-40ea-a121-8efd603497e9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:00.258066 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-64f3cc13-1581-40ea-a121-8efd603497e9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:00.387169 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:00.390526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-64f3cc13-1581-40ea-a121-8efd603497e9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:00.397778 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-64f3cc13-1581-40ea-a121-8efd603497e9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.152895 Jun 03 13:27:00.398630 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 324/600] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:00 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:27:01.271935 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:01.380664 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0d4464db-ae27-4c96-8ef5-9ad01213ef13 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:01.387615 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0d4464db-ae27-4c96-8ef5-9ad01213ef13 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:01.387615 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0d4464db-ae27-4c96-8ef5-9ad01213ef13 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:01.387895 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0d4464db-ae27-4c96-8ef5-9ad01213ef13 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:01.388682 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0d4464db-ae27-4c96-8ef5-9ad01213ef13 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:01.389127 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0d4464db-ae27-4c96-8ef5-9ad01213ef13 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:01.413547 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-062e61df-17d5-42ae-84f9-d89e473d9420 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:01.414149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-062e61df-17d5-42ae-84f9-d89e473d9420 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:01.416279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=6 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:01.422473 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-062e61df-17d5-42ae-84f9-d89e473d9420 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:01.423156 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-062e61df-17d5-42ae-84f9-d89e473d9420 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:01.423914 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-062e61df-17d5-42ae-84f9-d89e473d9420 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:01.424376 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-062e61df-17d5-42ae-84f9-d89e473d9420 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:01.522449 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0d4464db-ae27-4c96-8ef5-9ad01213ef13 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:01.531114 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0d4464db-ae27-4c96-8ef5-9ad01213ef13 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1731 microversion: 2.1 time: 0.263694 Jun 03 13:27:01.531774 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 277/601] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:01 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1731 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:01.556810 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-062e61df-17d5-42ae-84f9-d89e473d9420 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:01.562825 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:27:01.565645 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Fri Jun 3 13:27:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:27:01.565775 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-062e61df-17d5-42ae-84f9-d89e473d9420 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.155560 Jun 03 13:27:01.566006 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 325/602] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:01 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:27:02.548323 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b549bd05-ff8e-41eb-8219-4d4fcdee7e2c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:02.549958 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b549bd05-ff8e-41eb-8219-4d4fcdee7e2c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:02.556581 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b549bd05-ff8e-41eb-8219-4d4fcdee7e2c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:02.557040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b549bd05-ff8e-41eb-8219-4d4fcdee7e2c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:02.557806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b549bd05-ff8e-41eb-8219-4d4fcdee7e2c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:02.558248 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b549bd05-ff8e-41eb-8219-4d4fcdee7e2c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:02.582426 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6c2455bf-0136-4b41-b14e-3905c909dc39 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:02.583030 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6c2455bf-0136-4b41-b14e-3905c909dc39 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:02.589412 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6c2455bf-0136-4b41-b14e-3905c909dc39 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:02.589852 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6c2455bf-0136-4b41-b14e-3905c909dc39 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:02.590607 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6c2455bf-0136-4b41-b14e-3905c909dc39 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:02.591759 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6c2455bf-0136-4b41-b14e-3905c909dc39 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:02.691015 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b549bd05-ff8e-41eb-8219-4d4fcdee7e2c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:02.699036 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b549bd05-ff8e-41eb-8219-4d4fcdee7e2c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1711 microversion: 2.1 time: 0.154555 Jun 03 13:27:02.699615 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 278/603] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:02 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1711 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:02.721984 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6c2455bf-0136-4b41-b14e-3905c909dc39 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:02.729421 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6c2455bf-0136-4b41-b14e-3905c909dc39 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.150864 Jun 03 13:27:02.729983 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 326/604] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:02 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:27:02.754871 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-37c37ebf-2bec-4548-932c-50427a5bed44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:02.755405 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-37c37ebf-2bec-4548-932c-50427a5bed44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:02.761494 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-37c37ebf-2bec-4548-932c-50427a5bed44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:02.761946 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-37c37ebf-2bec-4548-932c-50427a5bed44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:02.763265 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-37c37ebf-2bec-4548-932c-50427a5bed44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:02.764108 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-37c37ebf-2bec-4548-932c-50427a5bed44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:02.890620 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-37c37ebf-2bec-4548-932c-50427a5bed44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] HTTP exception thrown: Cannot 'detach_volume' instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a while it is in vm_state rescued Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-37c37ebf-2bec-4548-932c-50427a5bed44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Request method failure captured: Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: DELETE /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments/c3d8b4a7-d231-4088-85e9-f1e3b1bf0201 HTTP/1.1 Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgr4hGDdogvcvqQUufQA49jnojsGlzdh6EROqvsENnZprcFlWM-FNGtFOQwPmvK6LhvJ8YyKCMkl8c6MysPOijBxI0Vi2CRs4KJvXzkVBev4KlhDZasL8Z9jVthzq5mfPBxmxK2Unmt23N3AFr0hGobck6dKQgRDP9GpkBAWrirmO7k Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 422fdba5c8474b93b285700c07e9304c Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:27:02.892257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:27:02.893809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_422fdba5c8474b93b285700c07e9304c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:27:02.893809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:27:02.893809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 422fdba5c8474b93b285700c07e9304c Jun 03 13:27:02.893809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:27:02.893809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-ServerRescueNegativeTestJSON-1706662507-project Jun 03 13:27:02.893809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:27:02.893809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:27:02.893809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 308bdbe63af5415d8e817bd9ba2fad3e Jun 03 13:27:02.893809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1706662507-project Jun 03 13:27:02.893809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:27:02.893809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Cannot 'detach_volume' instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a while it is in vm_state rescued Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'server_id': '5852e29d-4480-4e14-9e17-d4cccdcb7d1a', 'id': 'c3d8b4a7-d231-4088-85e9-f1e3b1bf0201'} Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:27:02.894694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a while it is in vm_state rescued Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a while it is in vm_state rescued Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:27:02.896260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-37c37ebf-2bec-4548-932c-50427a5bed44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Returning 409 to user: Cannot 'detach_volume' instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a while it is in vm_state rescued {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:27:02.897536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-37c37ebf-2bec-4548-932c-50427a5bed44 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments/c3d8b4a7-d231-4088-85e9-f1e3b1bf0201" status: 409 len: 152 microversion: 2.1 time: 0.142819 Jun 03 13:27:02.897536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 279/605] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 13:27:02 2022] DELETE /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments/c3d8b4a7-d231-4088-85e9-f1e3b1bf0201 => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 13:27:02.903107 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-13de430f-0246-46b6-88dd-03eef1e5cfe8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:27:02.904312 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-13de430f-0246-46b6-88dd-03eef1e5cfe8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:02.910453 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-13de430f-0246-46b6-88dd-03eef1e5cfe8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:02.910900 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-13de430f-0246-46b6-88dd-03eef1e5cfe8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:02.911650 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-13de430f-0246-46b6-88dd-03eef1e5cfe8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:02.912099 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-13de430f-0246-46b6-88dd-03eef1e5cfe8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:03.080913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-13de430f-0246-46b6-88dd-03eef1e5cfe8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "POST /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/action" status: 202 len: 0 microversion: 2.1 time: 0.181851 Jun 03 13:27:03.081579 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 327/606] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:27:02 2022] POST /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:27:03.089685 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0740cbdb-a3ae-4ac4-98a0-be7aa779aeb8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:03.090235 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0740cbdb-a3ae-4ac4-98a0-be7aa779aeb8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:03.097402 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0740cbdb-a3ae-4ac4-98a0-be7aa779aeb8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:03.097850 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0740cbdb-a3ae-4ac4-98a0-be7aa779aeb8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:03.098612 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0740cbdb-a3ae-4ac4-98a0-be7aa779aeb8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:03.099049 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0740cbdb-a3ae-4ac4-98a0-be7aa779aeb8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:03.224682 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0740cbdb-a3ae-4ac4-98a0-be7aa779aeb8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:03.232752 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0740cbdb-a3ae-4ac4-98a0-be7aa779aeb8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1719 microversion: 2.1 time: 0.147015 Jun 03 13:27:03.233308 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 280/607] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:03 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:27:03.746931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ca82b58d-bfc1-4475-a80c-10ae8542934d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:03.748225 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ca82b58d-bfc1-4475-a80c-10ae8542934d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:03.754346 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ca82b58d-bfc1-4475-a80c-10ae8542934d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:03.756915 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ca82b58d-bfc1-4475-a80c-10ae8542934d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:03.756915 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ca82b58d-bfc1-4475-a80c-10ae8542934d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:03.756915 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ca82b58d-bfc1-4475-a80c-10ae8542934d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:03.894332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ca82b58d-bfc1-4475-a80c-10ae8542934d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:03.902153 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ca82b58d-bfc1-4475-a80c-10ae8542934d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.159871 Jun 03 13:27:03.902724 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 328/608] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:03 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:04.251113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-bb926631-6402-4f0f-b94d-90b860b2eed5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:04.254879 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-bb926631-6402-4f0f-b94d-90b860b2eed5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:04.257802 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bb926631-6402-4f0f-b94d-90b860b2eed5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:04.258259 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bb926631-6402-4f0f-b94d-90b860b2eed5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:04.259468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bb926631-6402-4f0f-b94d-90b860b2eed5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:04.259468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bb926631-6402-4f0f-b94d-90b860b2eed5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:04.469193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-bb926631-6402-4f0f-b94d-90b860b2eed5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:04.477082 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-bb926631-6402-4f0f-b94d-90b860b2eed5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1719 microversion: 2.1 time: 0.230878 Jun 03 13:27:04.478856 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 281/609] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:04 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:04.919934 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8ca101b0-a9a4-4044-a058-7d478b536b07 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:04.920562 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8ca101b0-a9a4-4044-a058-7d478b536b07 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:04.927100 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8ca101b0-a9a4-4044-a058-7d478b536b07 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:04.927546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8ca101b0-a9a4-4044-a058-7d478b536b07 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:04.928348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8ca101b0-a9a4-4044-a058-7d478b536b07 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:04.928782 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8ca101b0-a9a4-4044-a058-7d478b536b07 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:05.061154 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8ca101b0-a9a4-4044-a058-7d478b536b07 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:05.068599 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8ca101b0-a9a4-4044-a058-7d478b536b07 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.153663 Jun 03 13:27:05.069166 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 329/610] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:04 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:05.494653 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c59b9221-6644-41a6-947a-834ad6bece39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:05.495263 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-c59b9221-6644-41a6-947a-834ad6bece39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:05.502669 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c59b9221-6644-41a6-947a-834ad6bece39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:05.503115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c59b9221-6644-41a6-947a-834ad6bece39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:05.503873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c59b9221-6644-41a6-947a-834ad6bece39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:05.504337 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c59b9221-6644-41a6-947a-834ad6bece39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:05.638795 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c59b9221-6644-41a6-947a-834ad6bece39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:05.647353 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c59b9221-6644-41a6-947a-834ad6bece39 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1719 microversion: 2.1 time: 0.156588 Jun 03 13:27:05.647922 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 282/611] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:05 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:06.085443 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d579e930-c1b0-4689-b9e3-4a3bfee9f33b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:06.086048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d579e930-c1b0-4689-b9e3-4a3bfee9f33b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:06.093594 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d579e930-c1b0-4689-b9e3-4a3bfee9f33b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:06.094038 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d579e930-c1b0-4689-b9e3-4a3bfee9f33b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:06.094791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d579e930-c1b0-4689-b9e3-4a3bfee9f33b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:06.095225 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d579e930-c1b0-4689-b9e3-4a3bfee9f33b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:06.226617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d579e930-c1b0-4689-b9e3-4a3bfee9f33b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:06.233511 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d579e930-c1b0-4689-b9e3-4a3bfee9f33b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.151865 Jun 03 13:27:06.234068 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 330/612] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:06 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:06.664845 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6d2685e0-a9f0-4a76-8d62-5cff6e148561 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:06.665451 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6d2685e0-a9f0-4a76-8d62-5cff6e148561 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:06.672055 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6d2685e0-a9f0-4a76-8d62-5cff6e148561 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:06.672539 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6d2685e0-a9f0-4a76-8d62-5cff6e148561 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:06.673303 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6d2685e0-a9f0-4a76-8d62-5cff6e148561 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:06.673739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6d2685e0-a9f0-4a76-8d62-5cff6e148561 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:06.799040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6d2685e0-a9f0-4a76-8d62-5cff6e148561 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:06.806946 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6d2685e0-a9f0-4a76-8d62-5cff6e148561 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1719 microversion: 2.1 time: 0.145945 Jun 03 13:27:06.807507 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 283/613] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:06 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1719 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:07.251095 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ecfc3bae-5481-4330-ac1d-b594cab16b92 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:07.251712 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ecfc3bae-5481-4330-ac1d-b594cab16b92 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:07.258277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ecfc3bae-5481-4330-ac1d-b594cab16b92 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:07.258731 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ecfc3bae-5481-4330-ac1d-b594cab16b92 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:07.259499 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ecfc3bae-5481-4330-ac1d-b594cab16b92 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:07.259943 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ecfc3bae-5481-4330-ac1d-b594cab16b92 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:07.265155 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-a24f6ea9-6934-49e3-b0af-578388558d48 req-b01040e7-df54-4690-aa03-e3b8ff5bf576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948a342e-2849-416a-a15b-86ca72bb08d7", "name": "network-vif-plugged", "status": "completed", "tag": "36459da4-523e-4b02-9ab9-8cf2c08ac474"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:27:07.273230 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-a24f6ea9-6934-49e3-b0af-578388558d48 req-b01040e7-df54-4690-aa03-e3b8ff5bf576 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:07.273662 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-a24f6ea9-6934-49e3-b0af-578388558d48 req-b01040e7-df54-4690-aa03-e3b8ff5bf576 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:07.284730 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-a24f6ea9-6934-49e3-b0af-578388558d48 req-b01040e7-df54-4690-aa03-e3b8ff5bf576 service nova] Creating event network-vif-plugged:36459da4-523e-4b02-9ab9-8cf2c08ac474 for instance 948a342e-2849-416a-a15b-86ca72bb08d7 on hv-cinder-80135 Jun 03 13:27:07.289683 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-a24f6ea9-6934-49e3-b0af-578388558d48 req-b01040e7-df54-4690-aa03-e3b8ff5bf576 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028535 Jun 03 13:27:07.290443 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 284/614] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:27:07.391899 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ecfc3bae-5481-4330-ac1d-b594cab16b92 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:07.399490 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ecfc3bae-5481-4330-ac1d-b594cab16b92 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.153361 Jun 03 13:27:07.400057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 331/615] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:07 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:07.826749 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-49688934-32e3-463c-975c-f02af701ae41 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:07.827370 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-49688934-32e3-463c-975c-f02af701ae41 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:07.833762 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-49688934-32e3-463c-975c-f02af701ae41 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:07.834212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-49688934-32e3-463c-975c-f02af701ae41 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:07.834972 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-49688934-32e3-463c-975c-f02af701ae41 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:07.835408 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-49688934-32e3-463c-975c-f02af701ae41 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:07.969021 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-49688934-32e3-463c-975c-f02af701ae41 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:07.976940 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-49688934-32e3-463c-975c-f02af701ae41 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1719 microversion: 2.1 time: 0.155763 Jun 03 13:27:07.977503 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 285/616] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:07 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:08.416507 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3b2898c5-555d-45e5-9b99-8ba728ded6b1 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:08.417138 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3b2898c5-555d-45e5-9b99-8ba728ded6b1 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:08.424225 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3b2898c5-555d-45e5-9b99-8ba728ded6b1 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:08.424673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3b2898c5-555d-45e5-9b99-8ba728ded6b1 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:08.425424 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3b2898c5-555d-45e5-9b99-8ba728ded6b1 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:08.425857 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3b2898c5-555d-45e5-9b99-8ba728ded6b1 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:08.551471 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3b2898c5-555d-45e5-9b99-8ba728ded6b1 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:08.553872 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:08.559749 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3b2898c5-555d-45e5-9b99-8ba728ded6b1 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.147123 Jun 03 13:27:08.560337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 332/617] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:08 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:08.994963 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-94873ebc-f9d6-4a36-8033-6e643134222e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:08.995570 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-94873ebc-f9d6-4a36-8033-6e643134222e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:09.002471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94873ebc-f9d6-4a36-8033-6e643134222e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:09.002916 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94873ebc-f9d6-4a36-8033-6e643134222e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:09.004024 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94873ebc-f9d6-4a36-8033-6e643134222e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:09.004493 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94873ebc-f9d6-4a36-8033-6e643134222e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:09.135918 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-94873ebc-f9d6-4a36-8033-6e643134222e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:09.144520 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-94873ebc-f9d6-4a36-8033-6e643134222e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1725 microversion: 2.1 time: 0.153634 Jun 03 13:27:09.145081 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 286/618] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:08 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:09.161274 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-34982682-3afc-4e66-9818-7597666c2750 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:09.161805 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-34982682-3afc-4e66-9818-7597666c2750 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:09.168196 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-34982682-3afc-4e66-9818-7597666c2750 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:09.168591 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-34982682-3afc-4e66-9818-7597666c2750 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:09.169693 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-34982682-3afc-4e66-9818-7597666c2750 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:09.170161 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-34982682-3afc-4e66-9818-7597666c2750 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:09.251195 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-34982682-3afc-4e66-9818-7597666c2750 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094094 Jun 03 13:27:09.251789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 333/619] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 13:27:09 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:27:09.576667 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a23471a7-9aaa-4e39-a496-12491b4f4d79 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:09.577277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a23471a7-9aaa-4e39-a496-12491b4f4d79 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:09.583205 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a23471a7-9aaa-4e39-a496-12491b4f4d79 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:09.583673 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a23471a7-9aaa-4e39-a496-12491b4f4d79 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:09.584479 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a23471a7-9aaa-4e39-a496-12491b4f4d79 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:09.584906 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a23471a7-9aaa-4e39-a496-12491b4f4d79 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:09.604578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=100 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:09.719710 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a23471a7-9aaa-4e39-a496-12491b4f4d79 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:09.727090 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a23471a7-9aaa-4e39-a496-12491b4f4d79 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.154563 Jun 03 13:27:09.727656 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 287/620] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:09 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:10.149286 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-51fced6e-11a1-4a30-a248-98ede70af9f8 req-9170094f-33c3-4264-8c15-ab7c0de93716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5852e29d-4480-4e14-9e17-d4cccdcb7d1a", "tag": "72222d2c-4db5-4768-b158-b370d5e0b875"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:27:10.158184 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-51fced6e-11a1-4a30-a248-98ede70af9f8 req-9170094f-33c3-4264-8c15-ab7c0de93716 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:10.158490 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-51fced6e-11a1-4a30-a248-98ede70af9f8 req-9170094f-33c3-4264-8c15-ab7c0de93716 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:10.170764 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-51fced6e-11a1-4a30-a248-98ede70af9f8 req-9170094f-33c3-4264-8c15-ab7c0de93716 service nova] Creating event network-changed:72222d2c-4db5-4768-b158-b370d5e0b875 for instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a on hv-cinder-80135 Jun 03 13:27:10.175784 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-51fced6e-11a1-4a30-a248-98ede70af9f8 req-9170094f-33c3-4264-8c15-ab7c0de93716 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031243 Jun 03 13:27:10.176420 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 334/621] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:27:10.745073 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1caa8f7f-2407-4dc6-877f-fd3512bb6000 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:10.745693 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-1caa8f7f-2407-4dc6-877f-fd3512bb6000 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:10.752977 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1caa8f7f-2407-4dc6-877f-fd3512bb6000 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:10.753428 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1caa8f7f-2407-4dc6-877f-fd3512bb6000 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:10.754203 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1caa8f7f-2407-4dc6-877f-fd3512bb6000 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:10.754641 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1caa8f7f-2407-4dc6-877f-fd3512bb6000 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:10.890266 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-1caa8f7f-2407-4dc6-877f-fd3512bb6000 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:10.898166 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-1caa8f7f-2407-4dc6-877f-fd3512bb6000 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1265 microversion: 2.1 time: 0.157076 Jun 03 13:27:10.898738 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 288/622] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:10 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:11.916991 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b83afdb5-01e1-4caa-a7bf-257356db9468 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:11.917690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b83afdb5-01e1-4caa-a7bf-257356db9468 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:11.924505 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b83afdb5-01e1-4caa-a7bf-257356db9468 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:11.924961 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b83afdb5-01e1-4caa-a7bf-257356db9468 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:11.925749 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b83afdb5-01e1-4caa-a7bf-257356db9468 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:11.926191 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b83afdb5-01e1-4caa-a7bf-257356db9468 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:12.056883 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b83afdb5-01e1-4caa-a7bf-257356db9468 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:12.064604 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b83afdb5-01e1-4caa-a7bf-257356db9468 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1451 microversion: 2.1 time: 0.152505 Jun 03 13:27:12.065169 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 335/623] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:11 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:12.080633 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0084fa62-6cd0-4616-b47b-f680463909ca tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:12.081242 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0084fa62-6cd0-4616-b47b-f680463909ca tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:12.087875 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0084fa62-6cd0-4616-b47b-f680463909ca tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:12.088402 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0084fa62-6cd0-4616-b47b-f680463909ca tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:12.089156 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0084fa62-6cd0-4616-b47b-f680463909ca tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:12.089592 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0084fa62-6cd0-4616-b47b-f680463909ca tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:12.190225 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-20090828-3aa6-48b1-9811-03162b2481ab req-bfc34662-6377-4d17-bb78-ddcf171dde58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5852e29d-4480-4e14-9e17-d4cccdcb7d1a", "tag": "72222d2c-4db5-4768-b158-b370d5e0b875"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:27:12.198057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-20090828-3aa6-48b1-9811-03162b2481ab req-bfc34662-6377-4d17-bb78-ddcf171dde58 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:12.198498 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-20090828-3aa6-48b1-9811-03162b2481ab req-bfc34662-6377-4d17-bb78-ddcf171dde58 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:12.209368 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-20090828-3aa6-48b1-9811-03162b2481ab req-bfc34662-6377-4d17-bb78-ddcf171dde58 service nova] Creating event network-changed:72222d2c-4db5-4768-b158-b370d5e0b875 for instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a on hv-cinder-80135 Jun 03 13:27:12.214090 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-20090828-3aa6-48b1-9811-03162b2481ab req-bfc34662-6377-4d17-bb78-ddcf171dde58 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027519 Jun 03 13:27:12.214878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 336/624] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:27:12.218874 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0084fa62-6cd0-4616-b47b-f680463909ca tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:12.226550 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0084fa62-6cd0-4616-b47b-f680463909ca tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1451 microversion: 2.1 time: 0.149760 Jun 03 13:27:12.227096 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 289/625] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:12 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:14.204616 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b59ca75c-3446-45d2-9d3d-c040f5112a2b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:27:14.205709 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b59ca75c-3446-45d2-9d3d-c040f5112a2b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:14.211891 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b59ca75c-3446-45d2-9d3d-c040f5112a2b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:14.212375 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b59ca75c-3446-45d2-9d3d-c040f5112a2b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:14.213140 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b59ca75c-3446-45d2-9d3d-c040f5112a2b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:14.213578 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b59ca75c-3446-45d2-9d3d-c040f5112a2b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:14.228559 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-d560d411-26e7-4b31-9781-1e2826b151c9 req-0e086b39-8d3f-43af-9da0-9c56da83a0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948a342e-2849-416a-a15b-86ca72bb08d7", "tag": "36459da4-523e-4b02-9ab9-8cf2c08ac474"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:27:14.238541 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-d560d411-26e7-4b31-9781-1e2826b151c9 req-0e086b39-8d3f-43af-9da0-9c56da83a0d4 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:14.239049 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-d560d411-26e7-4b31-9781-1e2826b151c9 req-0e086b39-8d3f-43af-9da0-9c56da83a0d4 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:14.252295 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-d560d411-26e7-4b31-9781-1e2826b151c9 req-0e086b39-8d3f-43af-9da0-9c56da83a0d4 service nova] Creating event network-changed:36459da4-523e-4b02-9ab9-8cf2c08ac474 for instance 948a342e-2849-416a-a15b-86ca72bb08d7 on hv-cinder-80135 Jun 03 13:27:14.257362 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-d560d411-26e7-4b31-9781-1e2826b151c9 req-0e086b39-8d3f-43af-9da0-9c56da83a0d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032400 Jun 03 13:27:14.258066 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 290/626] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:27:14.414265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b59ca75c-3446-45d2-9d3d-c040f5112a2b tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "POST /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/action" status: 202 len: 0 microversion: 2.1 time: 0.213389 Jun 03 13:27:14.414265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 337/627] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:27:14 2022] POST /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:27:14.423968 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-700ecf37-1f12-43a5-a326-2d1ee8588375 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:14.425658 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-700ecf37-1f12-43a5-a326-2d1ee8588375 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:14.431139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-700ecf37-1f12-43a5-a326-2d1ee8588375 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:14.431718 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-700ecf37-1f12-43a5-a326-2d1ee8588375 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:14.432636 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-700ecf37-1f12-43a5-a326-2d1ee8588375 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:14.433182 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-700ecf37-1f12-43a5-a326-2d1ee8588375 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:14.768620 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-700ecf37-1f12-43a5-a326-2d1ee8588375 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:14.782301 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-700ecf37-1f12-43a5-a326-2d1ee8588375 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1751 microversion: 2.1 time: 0.363637 Jun 03 13:27:14.783089 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 291/628] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:14 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1751 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:15.801326 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-46c2c35c-89a3-4a04-bb58-e082f57dd508 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:15.802053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-46c2c35c-89a3-4a04-bb58-e082f57dd508 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:15.808401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-46c2c35c-89a3-4a04-bb58-e082f57dd508 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:15.808797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-46c2c35c-89a3-4a04-bb58-e082f57dd508 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:15.809551 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-46c2c35c-89a3-4a04-bb58-e082f57dd508 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:15.809995 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-46c2c35c-89a3-4a04-bb58-e082f57dd508 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:15.951192 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-46c2c35c-89a3-4a04-bb58-e082f57dd508 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:15.959357 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-46c2c35c-89a3-4a04-bb58-e082f57dd508 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1756 microversion: 2.1 time: 0.162909 Jun 03 13:27:15.959925 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 338/629] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:15 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:16.976227 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-285446f3-17b3-4806-bd5c-ee6dc8e87e33 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:16.976843 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-285446f3-17b3-4806-bd5c-ee6dc8e87e33 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:16.984332 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-285446f3-17b3-4806-bd5c-ee6dc8e87e33 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:16.984779 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-285446f3-17b3-4806-bd5c-ee6dc8e87e33 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:16.985543 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-285446f3-17b3-4806-bd5c-ee6dc8e87e33 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:16.985979 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-285446f3-17b3-4806-bd5c-ee6dc8e87e33 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:17.127825 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-285446f3-17b3-4806-bd5c-ee6dc8e87e33 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:17.135751 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-285446f3-17b3-4806-bd5c-ee6dc8e87e33 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1756 microversion: 2.1 time: 0.163418 Jun 03 13:27:17.136346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 292/630] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:16 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:18.152779 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-23385c25-61d4-43c5-8ec1-95e876626d81 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:18.153386 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-23385c25-61d4-43c5-8ec1-95e876626d81 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:18.160560 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-23385c25-61d4-43c5-8ec1-95e876626d81 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:18.161007 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-23385c25-61d4-43c5-8ec1-95e876626d81 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:18.161761 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-23385c25-61d4-43c5-8ec1-95e876626d81 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:18.162197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-23385c25-61d4-43c5-8ec1-95e876626d81 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:18.301921 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-23385c25-61d4-43c5-8ec1-95e876626d81 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:18.310473 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-23385c25-61d4-43c5-8ec1-95e876626d81 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1756 microversion: 2.1 time: 0.160977 Jun 03 13:27:18.311036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 339/631] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:18 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:18.478390 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-929eecbe-8b25-42db-98df-c33569fb20f5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:18.478916 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-929eecbe-8b25-42db-98df-c33569fb20f5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:18.485605 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-929eecbe-8b25-42db-98df-c33569fb20f5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:18.486116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-929eecbe-8b25-42db-98df-c33569fb20f5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:18.486816 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-929eecbe-8b25-42db-98df-c33569fb20f5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:18.487247 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-929eecbe-8b25-42db-98df-c33569fb20f5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:18.570160 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-929eecbe-8b25-42db-98df-c33569fb20f5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lazy-loading 'services' on Instance uuid a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:27:18.801151 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-929eecbe-8b25-42db-98df-c33569fb20f5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/os-volume_attachments/b1a657d5-c351-479d-8371-3422fc66a696" status: 202 len: 0 microversion: 2.1 time: 0.427065 Jun 03 13:27:18.801862 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 293/632] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 13:27:18 2022] DELETE /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/os-volume_attachments/b1a657d5-c351-479d-8371-3422fc66a696 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:27:19.327380 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-baba328b-b8ae-4c5e-b624-2972da84b230 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:19.327985 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-baba328b-b8ae-4c5e-b624-2972da84b230 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:19.334511 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-baba328b-b8ae-4c5e-b624-2972da84b230 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:19.334958 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-baba328b-b8ae-4c5e-b624-2972da84b230 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:19.335703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-baba328b-b8ae-4c5e-b624-2972da84b230 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:19.336135 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-baba328b-b8ae-4c5e-b624-2972da84b230 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:19.704960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-baba328b-b8ae-4c5e-b624-2972da84b230 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:19.713182 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-baba328b-b8ae-4c5e-b624-2972da84b230 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1756 microversion: 2.1 time: 0.389596 Jun 03 13:27:19.713996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 340/633] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:19 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1756 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:20.731463 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9576bb02-054d-4408-9d96-5382480efec6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:20.732764 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-9576bb02-054d-4408-9d96-5382480efec6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:20.739052 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9576bb02-054d-4408-9d96-5382480efec6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:20.739496 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9576bb02-054d-4408-9d96-5382480efec6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:20.740288 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9576bb02-054d-4408-9d96-5382480efec6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:20.740754 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9576bb02-054d-4408-9d96-5382480efec6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:20.884060 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9576bb02-054d-4408-9d96-5382480efec6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:20.892300 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9576bb02-054d-4408-9d96-5382480efec6 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1756 microversion: 2.1 time: 0.165545 Jun 03 13:27:20.892859 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 294/634] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:20 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:20.964627 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-83559c4b-4b79-4e6b-a327-9f89e0d12d5e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:27:20.971115 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-83559c4b-4b79-4e6b-a327-9f89e0d12d5e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:20.971566 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-83559c4b-4b79-4e6b-a327-9f89e0d12d5e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:21.032834 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-83559c4b-4b79-4e6b-a327-9f89e0d12d5e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Going to try to stop instance {{(pid=118179) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 13:27:21.204836 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-83559c4b-4b79-4e6b-a327-9f89e0d12d5e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "POST /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/action" status: 202 len: 0 microversion: 2.1 time: 0.243734 Jun 03 13:27:21.205442 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 341/635] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:27:20 2022] POST /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:27:21.213590 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a2fc2ad1-40d3-4aeb-9408-394f83146be8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:21.214205 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a2fc2ad1-40d3-4aeb-9408-394f83146be8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:21.220945 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a2fc2ad1-40d3-4aeb-9408-394f83146be8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:21.221393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a2fc2ad1-40d3-4aeb-9408-394f83146be8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:21.222155 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a2fc2ad1-40d3-4aeb-9408-394f83146be8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:21.222591 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a2fc2ad1-40d3-4aeb-9408-394f83146be8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:21.358922 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a2fc2ad1-40d3-4aeb-9408-394f83146be8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:21.372706 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a2fc2ad1-40d3-4aeb-9408-394f83146be8 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.156726 Jun 03 13:27:21.372706 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 295/636] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:21 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:21.915930 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-59c95f87-6f38-4f3a-9060-9c1e00a33715 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:21.916569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-59c95f87-6f38-4f3a-9060-9c1e00a33715 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:21.923230 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-59c95f87-6f38-4f3a-9060-9c1e00a33715 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:21.923686 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-59c95f87-6f38-4f3a-9060-9c1e00a33715 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:21.924475 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-59c95f87-6f38-4f3a-9060-9c1e00a33715 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:21.924916 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-59c95f87-6f38-4f3a-9060-9c1e00a33715 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:22.070544 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-59c95f87-6f38-4f3a-9060-9c1e00a33715 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:22.079144 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-59c95f87-6f38-4f3a-9060-9c1e00a33715 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1756 microversion: 2.1 time: 0.167503 Jun 03 13:27:22.079704 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 342/637] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:21 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:22.383802 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-94cd61ce-7044-47c7-a530-2012cd01994a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:22.384459 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-94cd61ce-7044-47c7-a530-2012cd01994a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:22.391174 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94cd61ce-7044-47c7-a530-2012cd01994a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:22.391616 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94cd61ce-7044-47c7-a530-2012cd01994a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:22.392398 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94cd61ce-7044-47c7-a530-2012cd01994a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:22.392826 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94cd61ce-7044-47c7-a530-2012cd01994a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:22.521796 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-94cd61ce-7044-47c7-a530-2012cd01994a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:22.529225 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-94cd61ce-7044-47c7-a530-2012cd01994a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.149172 Jun 03 13:27:22.530552 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 296/638] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:22 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:23.096279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f65946b2-00f2-47ef-86d0-4f6e85bc6808 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:23.096879 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f65946b2-00f2-47ef-86d0-4f6e85bc6808 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:23.103273 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f65946b2-00f2-47ef-86d0-4f6e85bc6808 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:23.103811 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f65946b2-00f2-47ef-86d0-4f6e85bc6808 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:23.104591 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f65946b2-00f2-47ef-86d0-4f6e85bc6808 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:23.105022 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f65946b2-00f2-47ef-86d0-4f6e85bc6808 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:23.245001 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f65946b2-00f2-47ef-86d0-4f6e85bc6808 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:23.253929 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f65946b2-00f2-47ef-86d0-4f6e85bc6808 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1756 microversion: 2.1 time: 0.161602 Jun 03 13:27:23.254488 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 343/639] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:23 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:23.548018 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3c42aa14-4df2-4a8d-95d4-06a7b4df7844 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:23.548591 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3c42aa14-4df2-4a8d-95d4-06a7b4df7844 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:23.554957 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3c42aa14-4df2-4a8d-95d4-06a7b4df7844 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:23.555397 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3c42aa14-4df2-4a8d-95d4-06a7b4df7844 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:23.556162 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3c42aa14-4df2-4a8d-95d4-06a7b4df7844 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:23.556596 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3c42aa14-4df2-4a8d-95d4-06a7b4df7844 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:23.685490 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3c42aa14-4df2-4a8d-95d4-06a7b4df7844 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:23.693764 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3c42aa14-4df2-4a8d-95d4-06a7b4df7844 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.150421 Jun 03 13:27:23.694393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 297/640] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:23 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:24.271407 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2b9ccc61-ff04-449a-bdaa-262bfbfd203c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:24.271926 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2b9ccc61-ff04-449a-bdaa-262bfbfd203c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:24.278403 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2b9ccc61-ff04-449a-bdaa-262bfbfd203c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:24.278846 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2b9ccc61-ff04-449a-bdaa-262bfbfd203c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:24.279598 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2b9ccc61-ff04-449a-bdaa-262bfbfd203c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:24.280237 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2b9ccc61-ff04-449a-bdaa-262bfbfd203c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:24.418619 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2b9ccc61-ff04-449a-bdaa-262bfbfd203c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:24.427738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2b9ccc61-ff04-449a-bdaa-262bfbfd203c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1756 microversion: 2.1 time: 0.160195 Jun 03 13:27:24.428359 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 344/641] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:24 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:24.711435 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b9c5e8dc-3e00-4409-9be7-9613273bcf29 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:24.712074 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b9c5e8dc-3e00-4409-9be7-9613273bcf29 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:24.718955 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b9c5e8dc-3e00-4409-9be7-9613273bcf29 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:24.719394 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b9c5e8dc-3e00-4409-9be7-9613273bcf29 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:24.720290 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b9c5e8dc-3e00-4409-9be7-9613273bcf29 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:24.720723 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b9c5e8dc-3e00-4409-9be7-9613273bcf29 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:24.849347 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b9c5e8dc-3e00-4409-9be7-9613273bcf29 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:24.857629 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b9c5e8dc-3e00-4409-9be7-9613273bcf29 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.150106 Jun 03 13:27:24.858867 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 298/642] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:24 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:25.446895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b47b15bf-af8a-4fd8-b86c-4b971998dc87 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:25.447519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b47b15bf-af8a-4fd8-b86c-4b971998dc87 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:25.454917 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b47b15bf-af8a-4fd8-b86c-4b971998dc87 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:25.455371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b47b15bf-af8a-4fd8-b86c-4b971998dc87 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:25.456158 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b47b15bf-af8a-4fd8-b86c-4b971998dc87 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:25.456596 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b47b15bf-af8a-4fd8-b86c-4b971998dc87 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:25.604066 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b47b15bf-af8a-4fd8-b86c-4b971998dc87 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:25.613115 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b47b15bf-af8a-4fd8-b86c-4b971998dc87 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1756 microversion: 2.1 time: 0.171362 Jun 03 13:27:25.613685 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 345/643] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:25 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:27:25.875818 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0e8d6e04-790f-4414-a863-58e9d9ee405e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:25.876416 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0e8d6e04-790f-4414-a863-58e9d9ee405e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:25.882831 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0e8d6e04-790f-4414-a863-58e9d9ee405e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:25.883288 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0e8d6e04-790f-4414-a863-58e9d9ee405e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:25.884026 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0e8d6e04-790f-4414-a863-58e9d9ee405e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:25.884482 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0e8d6e04-790f-4414-a863-58e9d9ee405e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:26.020093 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0e8d6e04-790f-4414-a863-58e9d9ee405e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:26.027463 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0e8d6e04-790f-4414-a863-58e9d9ee405e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.156346 Jun 03 13:27:26.028017 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 299/644] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:25 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:26.631290 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c0f6cd1d-81e2-4be7-8cca-49c3b4c87edb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:26.631899 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c0f6cd1d-81e2-4be7-8cca-49c3b4c87edb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:26.634343 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=50 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:26.639010 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c0f6cd1d-81e2-4be7-8cca-49c3b4c87edb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:26.639486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c0f6cd1d-81e2-4be7-8cca-49c3b4c87edb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:26.640272 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c0f6cd1d-81e2-4be7-8cca-49c3b4c87edb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:26.640740 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c0f6cd1d-81e2-4be7-8cca-49c3b4c87edb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:26.777473 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c0f6cd1d-81e2-4be7-8cca-49c3b4c87edb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:26.785492 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c0f6cd1d-81e2-4be7-8cca-49c3b4c87edb tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1759 microversion: 2.1 time: 0.158072 Jun 03 13:27:26.786069 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 346/645] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:26 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1759 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:27.044859 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-5e8b98a5-2aac-4aaf-aca3-f7069c533662 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:27.046185 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-5e8b98a5-2aac-4aaf-aca3-f7069c533662 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:27.052764 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5e8b98a5-2aac-4aaf-aca3-f7069c533662 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:27.053210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5e8b98a5-2aac-4aaf-aca3-f7069c533662 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:27.053973 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5e8b98a5-2aac-4aaf-aca3-f7069c533662 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:27.054412 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5e8b98a5-2aac-4aaf-aca3-f7069c533662 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:27.187094 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5e8b98a5-2aac-4aaf-aca3-f7069c533662 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:27.194669 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-5e8b98a5-2aac-4aaf-aca3-f7069c533662 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.153617 Jun 03 13:27:27.195254 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 300/646] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:27 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:28.211862 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8d66d4c1-aebd-444b-a2ad-d1df1cb46365 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:28.212569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8d66d4c1-aebd-444b-a2ad-d1df1cb46365 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:28.218867 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8d66d4c1-aebd-444b-a2ad-d1df1cb46365 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:28.219308 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8d66d4c1-aebd-444b-a2ad-d1df1cb46365 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:28.220058 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8d66d4c1-aebd-444b-a2ad-d1df1cb46365 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:28.220525 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8d66d4c1-aebd-444b-a2ad-d1df1cb46365 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:28.358453 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8d66d4c1-aebd-444b-a2ad-d1df1cb46365 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:28.365798 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8d66d4c1-aebd-444b-a2ad-d1df1cb46365 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.157757 Jun 03 13:27:28.366361 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 347/647] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:28 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:29.382963 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6c4ffddb-6465-4398-8824-ab247da3d646 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:29.383491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6c4ffddb-6465-4398-8824-ab247da3d646 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:29.390989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6c4ffddb-6465-4398-8824-ab247da3d646 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:29.391434 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6c4ffddb-6465-4398-8824-ab247da3d646 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:29.392216 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6c4ffddb-6465-4398-8824-ab247da3d646 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:29.392652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6c4ffddb-6465-4398-8824-ab247da3d646 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:29.519714 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6c4ffddb-6465-4398-8824-ab247da3d646 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:29.527174 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6c4ffddb-6465-4398-8824-ab247da3d646 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.148108 Jun 03 13:27:29.527735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 301/648] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:29 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:30.545387 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e743c01a-27a7-457e-aef5-0a0d7ac0e49f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:30.546000 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e743c01a-27a7-457e-aef5-0a0d7ac0e49f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:30.552856 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e743c01a-27a7-457e-aef5-0a0d7ac0e49f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:30.553307 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e743c01a-27a7-457e-aef5-0a0d7ac0e49f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:30.554066 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e743c01a-27a7-457e-aef5-0a0d7ac0e49f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:30.554507 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e743c01a-27a7-457e-aef5-0a0d7ac0e49f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:30.679792 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e743c01a-27a7-457e-aef5-0a0d7ac0e49f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:30.687232 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e743c01a-27a7-457e-aef5-0a0d7ac0e49f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.145671 Jun 03 13:27:30.687787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 348/649] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:30 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:31.704853 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-fdaac2be-a79d-46b9-ab61-020bf6536739 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:31.705456 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-fdaac2be-a79d-46b9-ab61-020bf6536739 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:31.707896 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=52 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:31.712603 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fdaac2be-a79d-46b9-ab61-020bf6536739 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:31.713044 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fdaac2be-a79d-46b9-ab61-020bf6536739 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:31.713957 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fdaac2be-a79d-46b9-ab61-020bf6536739 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:31.714387 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fdaac2be-a79d-46b9-ab61-020bf6536739 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:31.846299 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-fdaac2be-a79d-46b9-ab61-020bf6536739 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:31.853694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-fdaac2be-a79d-46b9-ab61-020bf6536739 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.153414 Jun 03 13:27:31.854272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 302/650] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:31 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:32.871193 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-06d5ef89-d9fd-4b62-a9cf-9564ffeb6e97 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:32.871809 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-06d5ef89-d9fd-4b62-a9cf-9564ffeb6e97 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:32.879812 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-06d5ef89-d9fd-4b62-a9cf-9564ffeb6e97 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:32.880338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-06d5ef89-d9fd-4b62-a9cf-9564ffeb6e97 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:32.881168 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-06d5ef89-d9fd-4b62-a9cf-9564ffeb6e97 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:32.881642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-06d5ef89-d9fd-4b62-a9cf-9564ffeb6e97 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:32.887307 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:33.019857 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-06d5ef89-d9fd-4b62-a9cf-9564ffeb6e97 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:33.027649 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-06d5ef89-d9fd-4b62-a9cf-9564ffeb6e97 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.160684 Jun 03 13:27:33.028232 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 349/651] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:32 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:34.045432 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-092f587a-9c2a-440b-bdc8-1429fe81b789 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:34.046047 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-092f587a-9c2a-440b-bdc8-1429fe81b789 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:34.052819 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-092f587a-9c2a-440b-bdc8-1429fe81b789 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:34.053268 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-092f587a-9c2a-440b-bdc8-1429fe81b789 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:34.054028 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-092f587a-9c2a-440b-bdc8-1429fe81b789 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:34.054464 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-092f587a-9c2a-440b-bdc8-1429fe81b789 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:34.179649 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-092f587a-9c2a-440b-bdc8-1429fe81b789 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:34.187092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-092f587a-9c2a-440b-bdc8-1429fe81b789 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.145714 Jun 03 13:27:34.187663 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 303/652] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:34 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:35.205265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d2ad2d4c-8342-4cc0-8ea7-76b5e4404932 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:35.205881 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d2ad2d4c-8342-4cc0-8ea7-76b5e4404932 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:35.214713 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d2ad2d4c-8342-4cc0-8ea7-76b5e4404932 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:35.215160 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d2ad2d4c-8342-4cc0-8ea7-76b5e4404932 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:35.215928 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d2ad2d4c-8342-4cc0-8ea7-76b5e4404932 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:35.216384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d2ad2d4c-8342-4cc0-8ea7-76b5e4404932 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:35.360018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d2ad2d4c-8342-4cc0-8ea7-76b5e4404932 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:35.368360 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d2ad2d4c-8342-4cc0-8ea7-76b5e4404932 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.166986 Jun 03 13:27:35.370292 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 350/653] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:35 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:36.387022 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8fbc43b8-40b9-4f0d-913b-67b6937f01b2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:36.387655 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8fbc43b8-40b9-4f0d-913b-67b6937f01b2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:36.394320 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8fbc43b8-40b9-4f0d-913b-67b6937f01b2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:36.394765 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8fbc43b8-40b9-4f0d-913b-67b6937f01b2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:36.395514 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8fbc43b8-40b9-4f0d-913b-67b6937f01b2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:36.395944 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8fbc43b8-40b9-4f0d-913b-67b6937f01b2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:36.399850 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:36.525731 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8fbc43b8-40b9-4f0d-913b-67b6937f01b2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:36.533151 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8fbc43b8-40b9-4f0d-913b-67b6937f01b2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1677 microversion: 2.1 time: 0.150346 Jun 03 13:27:36.533950 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 304/654] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:36 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:37.550646 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6f4e2741-7141-47ff-9d1e-524f597de020 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:37.551254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6f4e2741-7141-47ff-9d1e-524f597de020 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:37.557843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6f4e2741-7141-47ff-9d1e-524f597de020 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:37.558309 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6f4e2741-7141-47ff-9d1e-524f597de020 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:37.559087 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6f4e2741-7141-47ff-9d1e-524f597de020 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:37.559509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6f4e2741-7141-47ff-9d1e-524f597de020 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:37.687392 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6f4e2741-7141-47ff-9d1e-524f597de020 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:37.695550 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6f4e2741-7141-47ff-9d1e-524f597de020 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1654 microversion: 2.1 time: 0.149083 Jun 03 13:27:37.696109 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 351/655] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:37 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1654 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:37.712612 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-bb6ecee0-0f47-4a41-b355-8dba0de40e86 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:27:37.719070 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bb6ecee0-0f47-4a41-b355-8dba0de40e86 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:37.719524 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bb6ecee0-0f47-4a41-b355-8dba0de40e86 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:37.742645 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-bb6ecee0-0f47-4a41-b355-8dba0de40e86 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Going to try to start instance {{(pid=118178) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 13:27:37.919473 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-bb6ecee0-0f47-4a41-b355-8dba0de40e86 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "POST /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/action" status: 202 len: 0 microversion: 2.1 time: 0.210593 Jun 03 13:27:37.920058 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 305/656] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:27:37 2022] POST /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 13:27:37.928780 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ac5a159e-7117-4ace-808d-711370d5bccf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:37.929393 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ac5a159e-7117-4ace-808d-711370d5bccf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:37.935371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac5a159e-7117-4ace-808d-711370d5bccf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:37.935825 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac5a159e-7117-4ace-808d-711370d5bccf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:37.936618 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac5a159e-7117-4ace-808d-711370d5bccf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:37.937054 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac5a159e-7117-4ace-808d-711370d5bccf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:38.070464 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ac5a159e-7117-4ace-808d-711370d5bccf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:38.078081 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ac5a159e-7117-4ace-808d-711370d5bccf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1663 microversion: 2.1 time: 0.153821 Jun 03 13:27:38.078662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 352/657] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:37 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:39.096943 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-5f255a37-8ae5-4bd2-b34d-258e00f59b28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:39.097627 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-5f255a37-8ae5-4bd2-b34d-258e00f59b28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:39.104611 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5f255a37-8ae5-4bd2-b34d-258e00f59b28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:39.105064 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5f255a37-8ae5-4bd2-b34d-258e00f59b28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:39.105826 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5f255a37-8ae5-4bd2-b34d-258e00f59b28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:39.106265 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5f255a37-8ae5-4bd2-b34d-258e00f59b28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:39.240865 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5f255a37-8ae5-4bd2-b34d-258e00f59b28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:39.248612 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-5f255a37-8ae5-4bd2-b34d-258e00f59b28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1663 microversion: 2.1 time: 0.155943 Jun 03 13:27:39.249177 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 306/658] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:39 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:40.266141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e4a5b1bb-2e02-411b-9f0c-8c380143f85e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:40.266690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e4a5b1bb-2e02-411b-9f0c-8c380143f85e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:40.273576 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4a5b1bb-2e02-411b-9f0c-8c380143f85e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:40.274028 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4a5b1bb-2e02-411b-9f0c-8c380143f85e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:40.274837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4a5b1bb-2e02-411b-9f0c-8c380143f85e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:40.275279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4a5b1bb-2e02-411b-9f0c-8c380143f85e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:40.401199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e4a5b1bb-2e02-411b-9f0c-8c380143f85e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:40.408505 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e4a5b1bb-2e02-411b-9f0c-8c380143f85e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1667 microversion: 2.1 time: 0.146249 Jun 03 13:27:40.409065 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 353/659] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:27:40 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1667 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:54.357491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=9 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:54.358153 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:54.461357 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f66a2b60-eedd-41da-b0bd-1ee5d3de00f2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:54.461846 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f66a2b60-eedd-41da-b0bd-1ee5d3de00f2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:54.467811 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f66a2b60-eedd-41da-b0bd-1ee5d3de00f2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:54.468296 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f66a2b60-eedd-41da-b0bd-1ee5d3de00f2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:54.469048 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f66a2b60-eedd-41da-b0bd-1ee5d3de00f2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:54.469479 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f66a2b60-eedd-41da-b0bd-1ee5d3de00f2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:54.502110 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f66a2b60-eedd-41da-b0bd-1ee5d3de00f2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-volume_attachments/1a4ae9af-643b-462e-a4e1-36b9e568b262" status: 200 len: 194 microversion: 2.20 time: 0.149933 Jun 03 13:27:54.502663 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 307/660] 10.222.0.61 () {60 vars in 1453 bytes} [Fri Jun 3 13:27:54 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-volume_attachments/1a4ae9af-643b-462e-a4e1-36b9e568b262 => generated 194 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:27:54.564315 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f7ca0f13-8a50-4813-a9a2-369be310f2e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:54.564838 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f7ca0f13-8a50-4813-a9a2-369be310f2e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:54.567306 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=15 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:54.567952 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=29 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:54.573280 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f7ca0f13-8a50-4813-a9a2-369be310f2e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:54.573729 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f7ca0f13-8a50-4813-a9a2-369be310f2e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:54.574487 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f7ca0f13-8a50-4813-a9a2-369be310f2e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:54.574924 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f7ca0f13-8a50-4813-a9a2-369be310f2e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:54.696800 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-f7ca0f13-8a50-4813-a9a2-369be310f2e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lazy-loading 'services' on Instance uuid 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:27:54.955281 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f7ca0f13-8a50-4813-a9a2-369be310f2e1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-volume_attachments/1a4ae9af-643b-462e-a4e1-36b9e568b262" status: 202 len: 0 microversion: 2.20 time: 0.394481 Jun 03 13:27:54.955882 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 354/661] 10.222.0.61 () {60 vars in 1456 bytes} [Fri Jun 3 13:27:54 2022] DELETE /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-volume_attachments/1a4ae9af-643b-462e-a4e1-36b9e568b262 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:27:54.964619 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ad879484-a1bf-43fc-bd20-5075eeeee4d9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:54.969550 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ad879484-a1bf-43fc-bd20-5075eeeee4d9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:54.971974 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ad879484-a1bf-43fc-bd20-5075eeeee4d9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:54.972453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ad879484-a1bf-43fc-bd20-5075eeeee4d9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:54.973316 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ad879484-a1bf-43fc-bd20-5075eeeee4d9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:54.973655 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ad879484-a1bf-43fc-bd20-5075eeeee4d9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:55.003369 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ad879484-a1bf-43fc-bd20-5075eeeee4d9 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042774 Jun 03 13:27:55.003897 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 308/662] 10.222.0.61 () {60 vars in 1342 bytes} [Fri Jun 3 13:27:54 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:27:56.017404 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4e213af0-4441-407a-9262-d26ca6a0788e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:56.018507 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4e213af0-4441-407a-9262-d26ca6a0788e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:56.025515 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4e213af0-4441-407a-9262-d26ca6a0788e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:56.026629 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4e213af0-4441-407a-9262-d26ca6a0788e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:56.027143 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4e213af0-4441-407a-9262-d26ca6a0788e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:56.027706 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4e213af0-4441-407a-9262-d26ca6a0788e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:56.058620 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4e213af0-4441-407a-9262-d26ca6a0788e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046335 Jun 03 13:27:56.059173 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 355/663] 10.222.0.61 () {60 vars in 1342 bytes} [Fri Jun 3 13:27:56 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:27:57.070587 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-aab239a4-cae9-4b03-885a-75f768671d77 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:57.071494 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-aab239a4-cae9-4b03-885a-75f768671d77 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:57.077981 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-aab239a4-cae9-4b03-885a-75f768671d77 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:57.078425 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-aab239a4-cae9-4b03-885a-75f768671d77 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:57.079194 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-aab239a4-cae9-4b03-885a-75f768671d77 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:57.079623 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-aab239a4-cae9-4b03-885a-75f768671d77 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:57.107780 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-aab239a4-cae9-4b03-885a-75f768671d77 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041272 Jun 03 13:27:57.108360 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 309/664] 10.222.0.61 () {60 vars in 1342 bytes} [Fri Jun 3 13:27:57 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:27:57.166885 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-59beadd4-9489-4522-921d-1de3da9828d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:57.167401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-59beadd4-9489-4522-921d-1de3da9828d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:57.173412 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-59beadd4-9489-4522-921d-1de3da9828d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:57.174040 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-59beadd4-9489-4522-921d-1de3da9828d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:57.174693 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-59beadd4-9489-4522-921d-1de3da9828d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:57.175124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-59beadd4-9489-4522-921d-1de3da9828d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:57.201497 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-59beadd4-9489-4522-921d-1de3da9828d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Going to try to terminate instance {{(pid=118179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:27:57.499125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-59beadd4-9489-4522-921d-1de3da9828d2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 204 len: 0 microversion: 2.20 time: 0.336549 Jun 03 13:27:57.499712 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 356/665] 10.222.0.61 () {60 vars in 1279 bytes} [Fri Jun 3 13:27:57 2022] DELETE /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 13:27:57.513759 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-5dd72a6a-108a-4d8b-8931-e75f589e4432 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:57.514395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-5dd72a6a-108a-4d8b-8931-e75f589e4432 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:57.520523 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5dd72a6a-108a-4d8b-8931-e75f589e4432 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:57.520976 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5dd72a6a-108a-4d8b-8931-e75f589e4432 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:57.522442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5dd72a6a-108a-4d8b-8931-e75f589e4432 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:57.523095 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5dd72a6a-108a-4d8b-8931-e75f589e4432 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:57.656309 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5dd72a6a-108a-4d8b-8931-e75f589e4432 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:57.664221 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5dd72a6a-108a-4d8b-8931-e75f589e4432 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:57.676966 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5dd72a6a-108a-4d8b-8931-e75f589e4432 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:57.676966 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-5dd72a6a-108a-4d8b-8931-e75f589e4432 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.157122 Jun 03 13:27:57.676966 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 310/666] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:27:57 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:27:58.685795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-cf1ff51a-d389-4d98-8a43-e4bedac7bfa1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:58.686483 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-cf1ff51a-d389-4d98-8a43-e4bedac7bfa1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:58.692974 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cf1ff51a-d389-4d98-8a43-e4bedac7bfa1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:58.693422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cf1ff51a-d389-4d98-8a43-e4bedac7bfa1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:58.694176 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cf1ff51a-d389-4d98-8a43-e4bedac7bfa1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:58.694845 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cf1ff51a-d389-4d98-8a43-e4bedac7bfa1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:58.825213 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cf1ff51a-d389-4d98-8a43-e4bedac7bfa1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:58.833118 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cf1ff51a-d389-4d98-8a43-e4bedac7bfa1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:58.837565 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cf1ff51a-d389-4d98-8a43-e4bedac7bfa1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:27:58.837565 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-cf1ff51a-d389-4d98-8a43-e4bedac7bfa1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.154743 Jun 03 13:27:58.837565 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 357/667] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:27:58 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:27:59.854583 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d301fb52-8b0b-4a29-9b77-85c8874bce3b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:27:59.855121 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d301fb52-8b0b-4a29-9b77-85c8874bce3b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:27:59.861596 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d301fb52-8b0b-4a29-9b77-85c8874bce3b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:59.862041 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d301fb52-8b0b-4a29-9b77-85c8874bce3b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:27:59.862831 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d301fb52-8b0b-4a29-9b77-85c8874bce3b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:27:59.863267 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d301fb52-8b0b-4a29-9b77-85c8874bce3b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:00.082123 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d301fb52-8b0b-4a29-9b77-85c8874bce3b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:00.090765 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d301fb52-8b0b-4a29-9b77-85c8874bce3b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:00.092471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d301fb52-8b0b-4a29-9b77-85c8874bce3b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:00.093640 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d301fb52-8b0b-4a29-9b77-85c8874bce3b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1726 microversion: 2.20 time: 0.243043 Jun 03 13:28:00.094199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 311/668] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:27:59 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1726 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:28:00.947886 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-1ad5c0dc-242d-4715-b926-9feabfeb8c2c req-3bf86cad-ca47-47a2-a2b7-36a2ceda9195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f119f5f-b6ed-45a0-a780-b1e037c96cc1", "name": "network-vif-deleted", "tag": "14995843-d975-4a00-9ad9-746c61f720d5"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:00.956050 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-1ad5c0dc-242d-4715-b926-9feabfeb8c2c req-3bf86cad-ca47-47a2-a2b7-36a2ceda9195 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:00.956522 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-1ad5c0dc-242d-4715-b926-9feabfeb8c2c req-3bf86cad-ca47-47a2-a2b7-36a2ceda9195 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:00.968590 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-1ad5c0dc-242d-4715-b926-9feabfeb8c2c req-3bf86cad-ca47-47a2-a2b7-36a2ceda9195 service nova] Creating event network-vif-deleted:14995843-d975-4a00-9ad9-746c61f720d5 for instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 on hv-cinder-80135 Jun 03 13:28:00.973433 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-1ad5c0dc-242d-4715-b926-9feabfeb8c2c req-3bf86cad-ca47-47a2-a2b7-36a2ceda9195 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092603 Jun 03 13:28:00.974053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 358/669] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:01.112021 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:01.113485 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:01.120650 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:01.121099 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:01.121889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:01.122318 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:01.158248 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:01.158707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:01.159157 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lazy-loading 'fault' on Instance uuid 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:01.203621 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:01.213120 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:01.215182 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:01.216689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d35cf47d-6f44-4db6-a2d7-c69787516492 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 200 len: 1372 microversion: 2.20 time: 0.109031 Jun 03 13:28:01.217795 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 312/670] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:01 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:28:02.238180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c1102cf8-0abb-47ba-b89c-a7f83e38b29a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:02.238872 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c1102cf8-0abb-47ba-b89c-a7f83e38b29a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:02.245322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c1102cf8-0abb-47ba-b89c-a7f83e38b29a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:02.245710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c1102cf8-0abb-47ba-b89c-a7f83e38b29a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:02.246458 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c1102cf8-0abb-47ba-b89c-a7f83e38b29a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:02.246891 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c1102cf8-0abb-47ba-b89c-a7f83e38b29a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:02.260796 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-c1102cf8-0abb-47ba-b89c-a7f83e38b29a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] HTTP exception thrown: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c1102cf8-0abb-47ba-b89c-a7f83e38b29a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Request method failure captured: Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 HTTP/1.1 Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr3M6Fknh-eNkB9nc5wXKNKLLE8WWCiRODkVCNRG88hg-zlGD_5DTtDIf8Ti99znTclWUm25bUsez253AZwf5dNyhILL2OeCRkc9y5BSRp2fc1zgvIkj7H6euW_gAFvw2KO36v4u3qujclASOfCH1n7RRLAqWHb5MJR-szXaZgM7Vk Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: ab17731336f54a7eb5dfd954ddc8e688 Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:28:02.262384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:28:02.264014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ab17731336f54a7eb5dfd954ddc8e688", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:28:02.264014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:28:02.264014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: ab17731336f54a7eb5dfd954ddc8e688 Jun 03 13:28:02.264014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:28:02.264014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeShelveTestJSON-1846933890-project Jun 03 13:28:02.264014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:28:02.264014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:28:02.264014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 965645bc86f44cf38c5f571406722e32 Jun 03 13:28:02.264014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1846933890-project Jun 03 13:28:02.264014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:28:02.264014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:28:02.264014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '8f119f5f-b6ed-45a0-a780-b1e037c96cc1'} Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:28:02.265057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:28:02.266563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:02.268075 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c1102cf8-0abb-47ba-b89c-a7f83e38b29a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Returning 404 to user: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:28:02.268075 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c1102cf8-0abb-47ba-b89c-a7f83e38b29a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 404 len: 111 microversion: 2.20 time: 0.030245 Jun 03 13:28:02.268075 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 359/671] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:02 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:28:02.273835 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c13d029b-b545-4544-b5f1-7de7d6a0ee6e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '.version_select at 0x7f5bc821b9d0>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:02.351901 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c13d029b-b545-4544-b5f1-7de7d6a0ee6e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524464403" status: 204 len: 0 microversion: 2.20 time: 0.082626 Jun 03 13:28:02.352500 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 313/672] 10.222.0.61 () {60 vars in 1261 bytes} [Fri Jun 3 13:28:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524464403 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 13:28:03.148418 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3fa3bfad-2740-433c-943a-ee42eaff42e4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Action: 'create', calling method: .version_select at 0x7f5bc81181f0>, body: {"keypair": {"name": "tempest-keypair-1993816076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvYYB68+sN/jE6mhRDlVn+6o6LPK8G++LwLDBe/TrJC4ts1CK3+jCoWY3vJemUQYNEXlBDfZ+brwdWGEdAwb5UgHRNJLJ7HHNQbyAq55ZidaBPgzn86qJ0gxhsoCM4qQA=="}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:03.159046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-711d096e-bd4a-4b2a-a0cf-63280f35047f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:03.159866 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-711d096e-bd4a-4b2a-a0cf-63280f35047f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:03.166356 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-3fa3bfad-2740-433c-943a-ee42eaff42e4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Getting quotas for project ab17731336f54a7eb5dfd954ddc8e688. Resources: {'key_pairs'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:28:03.167669 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-711d096e-bd4a-4b2a-a0cf-63280f35047f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:03.168220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-711d096e-bd4a-4b2a-a0cf-63280f35047f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:03.169273 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-711d096e-bd4a-4b2a-a0cf-63280f35047f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:03.169987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-711d096e-bd4a-4b2a-a0cf-63280f35047f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:03.170592 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-3fa3bfad-2740-433c-943a-ee42eaff42e4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Getting quotas for user 965645bc86f44cf38c5f571406722e32 and project ab17731336f54a7eb5dfd954ddc8e688. Resources: {'key_pairs'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:28:03.198776 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-711d096e-bd4a-4b2a-a0cf-63280f35047f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7/ips" status: 200 len: 149 microversion: 2.1 time: 0.171145 Jun 03 13:28:03.199423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 360/673] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 13:28:03 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7/ips => generated 149 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:03.218090 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e777250b-7080-4291-9eb1-9ce605c70df8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "333386db-53ba-416f-b0fa-d9a0cfb16fb2"}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:03.219104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e777250b-7080-4291-9eb1-9ce605c70df8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:03.226209 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e777250b-7080-4291-9eb1-9ce605c70df8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:03.226658 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e777250b-7080-4291-9eb1-9ce605c70df8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:03.227434 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e777250b-7080-4291-9eb1-9ce605c70df8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:03.227875 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e777250b-7080-4291-9eb1-9ce605c70df8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:03.260675 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3fa3bfad-2740-433c-943a-ee42eaff42e4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.116604 Jun 03 13:28:03.261833 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 314/674] 10.222.0.61 () {62 vars in 1199 bytes} [Fri Jun 3 13:28:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 13:28:03.322986 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-e777250b-7080-4291-9eb1-9ce605c70df8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Invalid volume: volume 333386db-53ba-416f-b0fa-d9a0cfb16fb2 is already attached to instances: 7f916e17-eccc-4c6d-b3cd-9517056abcfc Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e777250b-7080-4291-9eb1-9ce605c70df8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: POST /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7/os-volume_attachments HTTP/1.1 Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 74 Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:28:03.324676 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:28:03.326243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:28:03.326243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:28:03.326243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:28:03.326243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:28:03.326243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:28:03.326243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:28:03.326243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:28:03.326243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:28:03.326243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:28:03.326243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Jun 03 13:28:03.326243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {"volumeAttachment": {"volumeId": "333386db-53ba-416f-b0fa-d9a0cfb16fb2"}} Jun 03 13:28:03.326243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Invalid volume: volume 333386db-53ba-416f-b0fa-d9a0cfb16fb2 is already attached to instances: 7f916e17-eccc-4c6d-b3cd-9517056abcfc Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'server_id': 'c95a8052-ebb8-4326-83e4-85340beb68e7', 'body': {'volumeAttachment': {'volumeId': '333386db-53ba-416f-b0fa-d9a0cfb16fb2'}}} Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 333386db-53ba-416f-b0fa-d9a0cfb16fb2 is already attached to instances: 7f916e17-eccc-4c6d-b3cd-9517056abcfc Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:03.327506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 333386db-53ba-416f-b0fa-d9a0cfb16fb2 is already attached to instances: 7f916e17-eccc-4c6d-b3cd-9517056abcfc Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:03.328964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:03.330667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:03.330667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:28:03.330667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:28:03.330667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 333386db-53ba-416f-b0fa-d9a0cfb16fb2 is already attached to instances: 7f916e17-eccc-4c6d-b3cd-9517056abcfc Jun 03 13:28:03.330667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:03.330667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e777250b-7080-4291-9eb1-9ce605c70df8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 400 to user: Invalid volume: volume 333386db-53ba-416f-b0fa-d9a0cfb16fb2 is already attached to instances: 7f916e17-eccc-4c6d-b3cd-9517056abcfc {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:28:03.330667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e777250b-7080-4291-9eb1-9ce605c70df8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112346 Jun 03 13:28:03.330667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 361/675] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:28:03 2022] POST /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 03 13:28:03.336825 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ab89a68a-114a-48bc-8aca-b88a3c8c05f7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:03.337516 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ab89a68a-114a-48bc-8aca-b88a3c8c05f7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:03.343571 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab89a68a-114a-48bc-8aca-b88a3c8c05f7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:03.344278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab89a68a-114a-48bc-8aca-b88a3c8c05f7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:03.344915 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab89a68a-114a-48bc-8aca-b88a3c8c05f7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:03.345357 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ab89a68a-114a-48bc-8aca-b88a3c8c05f7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:03.371736 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ab89a68a-114a-48bc-8aca-b88a3c8c05f7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Going to try to terminate instance {{(pid=118178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:28:03.612867 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ab89a68a-114a-48bc-8aca-b88a3c8c05f7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 204 len: 0 microversion: 2.1 time: 0.279666 Jun 03 13:28:03.614727 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 315/676] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:28:03 2022] DELETE /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:28:03.621714 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-32040bd5-f04a-43c8-a501-9cfeca63a453 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:03.622323 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-32040bd5-f04a-43c8-a501-9cfeca63a453 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:03.631680 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-32040bd5-f04a-43c8-a501-9cfeca63a453 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:03.632399 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-32040bd5-f04a-43c8-a501-9cfeca63a453 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:03.633197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-32040bd5-f04a-43c8-a501-9cfeca63a453 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:03.633629 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-32040bd5-f04a-43c8-a501-9cfeca63a453 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:03.769161 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-32040bd5-f04a-43c8-a501-9cfeca63a453 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:03.777338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-32040bd5-f04a-43c8-a501-9cfeca63a453 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1679 microversion: 2.1 time: 0.159512 Jun 03 13:28:03.777897 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 362/677] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:03 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:04.795444 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-346b465f-9782-44b2-8c64-c088f3f62db5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:04.796358 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-346b465f-9782-44b2-8c64-c088f3f62db5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:04.803687 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-346b465f-9782-44b2-8c64-c088f3f62db5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:04.804284 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-346b465f-9782-44b2-8c64-c088f3f62db5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:04.805118 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-346b465f-9782-44b2-8c64-c088f3f62db5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:04.805564 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-346b465f-9782-44b2-8c64-c088f3f62db5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:04.991132 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-346b465f-9782-44b2-8c64-c088f3f62db5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:05.003632 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-346b465f-9782-44b2-8c64-c088f3f62db5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1679 microversion: 2.1 time: 0.212461 Jun 03 13:28:05.004243 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 316/678] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:04 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:05.416558 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2122567250", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "040a4fd6-75dc-4026-9586-7c7b1dfd5d98"}], "security_groups": [{"name": "tempest-securitygroup--1626682683"}], "key_name": "tempest-keypair-1993816076", "user_data": "}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:05.516024 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] validate_networks() for [('040a4fd6-75dc-4026-9586-7c7b1dfd5d98', None, None, None, None, None)] {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:28:05.877502 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:28:05.877921 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:28:05.878390 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:28:05.878789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:28:05.879190 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:28:05.887953 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:05.888426 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:05.889210 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:05.889638 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:05.906524 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Getting quotas for project ab17731336f54a7eb5dfd954ddc8e688. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:28:05.910341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Getting quotas for user 965645bc86f44cf38c5f571406722e32 and project ab17731336f54a7eb5dfd954ddc8e688. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:28:05.921687 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:28:05.923940 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:28:06.021127 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-45fdba48-b445-4ed7-9bc0-33f13cf3db17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:06.022390 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-45fdba48-b445-4ed7-9bc0-33f13cf3db17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:06.029283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-45fdba48-b445-4ed7-9bc0-33f13cf3db17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:06.029728 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-45fdba48-b445-4ed7-9bc0-33f13cf3db17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:06.030524 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-45fdba48-b445-4ed7-9bc0-33f13cf3db17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:06.030962 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-45fdba48-b445-4ed7-9bc0-33f13cf3db17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:06.058876 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f11f3fc7-8e1b-43f4-bf8d-f7d39f0d02b3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.647367 Jun 03 13:28:06.059888 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 363/679] 10.222.0.61 () {62 vars in 1187 bytes} [Fri Jun 3 13:28:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 13:28:06.069778 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6f4acdd9-6ca4-418a-8dd6-d22dad2e88ff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:06.070395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6f4acdd9-6ca4-418a-8dd6-d22dad2e88ff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:06.125482 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6f4acdd9-6ca4-418a-8dd6-d22dad2e88ff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:06.134030 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6f4acdd9-6ca4-418a-8dd6-d22dad2e88ff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:06.135884 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6f4acdd9-6ca4-418a-8dd6-d22dad2e88ff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:06.137470 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6f4acdd9-6ca4-418a-8dd6-d22dad2e88ff tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1282 microversion: 2.20 time: 0.071546 Jun 03 13:28:06.138384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 364/680] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:06 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:28:06.238908 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-45fdba48-b445-4ed7-9bc0-33f13cf3db17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:06.247088 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-45fdba48-b445-4ed7-9bc0-33f13cf3db17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1679 microversion: 2.1 time: 0.229801 Jun 03 13:28:06.247662 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 317/681] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:06 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:28:06.640768 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-79182bf7-e8d1-453c-add8-b395c9ce8e6c req-fce18dcf-085c-48e4-9f0f-9c76203d0d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95a8052-ebb8-4326-83e4-85340beb68e7", "name": "network-vif-deleted", "tag": "20ec12a9-5558-4ed8-a89c-b0b033b62225"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:06.650467 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-79182bf7-e8d1-453c-add8-b395c9ce8e6c req-fce18dcf-085c-48e4-9f0f-9c76203d0d47 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:06.650984 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-79182bf7-e8d1-453c-add8-b395c9ce8e6c req-fce18dcf-085c-48e4-9f0f-9c76203d0d47 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:06.663117 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-79182bf7-e8d1-453c-add8-b395c9ce8e6c req-fce18dcf-085c-48e4-9f0f-9c76203d0d47 service nova] Creating event network-vif-deleted:20ec12a9-5558-4ed8-a89c-b0b033b62225 for instance c95a8052-ebb8-4326-83e4-85340beb68e7 on hv-cinder-80135 Jun 03 13:28:06.668328 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-79182bf7-e8d1-453c-add8-b395c9ce8e6c req-fce18dcf-085c-48e4-9f0f-9c76203d0d47 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031578 Jun 03 13:28:06.671002 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 365/682] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:07.157121 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-faaf4567-7f1c-4a69-9af9-26473bf4edce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:07.157737 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-faaf4567-7f1c-4a69-9af9-26473bf4edce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:07.164684 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-faaf4567-7f1c-4a69-9af9-26473bf4edce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:07.165141 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-faaf4567-7f1c-4a69-9af9-26473bf4edce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:07.165946 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-faaf4567-7f1c-4a69-9af9-26473bf4edce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:07.166386 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-faaf4567-7f1c-4a69-9af9-26473bf4edce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:07.227686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-faaf4567-7f1c-4a69-9af9-26473bf4edce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:07.236100 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-faaf4567-7f1c-4a69-9af9-26473bf4edce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:07.237613 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-faaf4567-7f1c-4a69-9af9-26473bf4edce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:07.238695 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-faaf4567-7f1c-4a69-9af9-26473bf4edce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1278 microversion: 2.20 time: 0.085656 Jun 03 13:28:07.239252 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 318/683] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:07 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:28:07.265758 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2c8fcd63-8f57-425b-817e-c4472113e1ac tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:07.266599 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2c8fcd63-8f57-425b-817e-c4472113e1ac tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:07.274219 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2c8fcd63-8f57-425b-817e-c4472113e1ac tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:07.274529 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2c8fcd63-8f57-425b-817e-c4472113e1ac tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:07.275390 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2c8fcd63-8f57-425b-817e-c4472113e1ac tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:07.275886 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2c8fcd63-8f57-425b-817e-c4472113e1ac tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:07.310952 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2c8fcd63-8f57-425b-817e-c4472113e1ac tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:07.311398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2c8fcd63-8f57-425b-817e-c4472113e1ac tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:07.311848 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-2c8fcd63-8f57-425b-817e-c4472113e1ac tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lazy-loading 'fault' on Instance uuid c95a8052-ebb8-4326-83e4-85340beb68e7 {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:07.360279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2c8fcd63-8f57-425b-817e-c4472113e1ac tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:07.372860 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2c8fcd63-8f57-425b-817e-c4472113e1ac tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 200 len: 1330 microversion: 2.1 time: 0.111748 Jun 03 13:28:07.374447 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 366/684] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:07 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 1330 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:08.258400 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-702247f6-2613-4e56-9ead-f3dc244413e0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:08.258929 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-702247f6-2613-4e56-9ead-f3dc244413e0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:08.265595 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-702247f6-2613-4e56-9ead-f3dc244413e0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:08.266039 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-702247f6-2613-4e56-9ead-f3dc244413e0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:08.266801 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-702247f6-2613-4e56-9ead-f3dc244413e0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:08.267310 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-702247f6-2613-4e56-9ead-f3dc244413e0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:08.391736 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-161f7f49-a553-4593-a359-7535eb77cdb5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:08.392530 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-161f7f49-a553-4593-a359-7535eb77cdb5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:08.399557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-161f7f49-a553-4593-a359-7535eb77cdb5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:08.400040 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-161f7f49-a553-4593-a359-7535eb77cdb5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:08.400851 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-161f7f49-a553-4593-a359-7535eb77cdb5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:08.401762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-161f7f49-a553-4593-a359-7535eb77cdb5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:08.418348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-161f7f49-a553-4593-a359-7535eb77cdb5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-161f7f49-a553-4593-a359-7535eb77cdb5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 HTTP/1.1 Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:28:08.420104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:28:08.421830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:28:08.421830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:28:08.421830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:28:08.421830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:28:08.421830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:28:08.421830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:28:08.421830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:28:08.421830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:28:08.421830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:28:08.421830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:28:08.421830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:28:08.421830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': 'c95a8052-ebb8-4326-83e4-85340beb68e7'} Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:28:08.422617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:28:08.423895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:08.424985 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-161f7f49-a553-4593-a359-7535eb77cdb5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 404 to user: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:28:08.424985 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-161f7f49-a553-4593-a359-7535eb77cdb5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 404 len: 111 microversion: 2.1 time: 0.034523 Jun 03 13:28:08.424985 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 367/685] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:08 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:28:08.431672 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e93afd03-7c37-488b-ba0b-ddcab56d42ae tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '.version_select at 0x7f5bc88d21f0>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:08.489113 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e93afd03-7c37-488b-ba0b-ddcab56d42ae tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-311302372" status: 202 len: 0 microversion: 2.1 time: 0.062121 Jun 03 13:28:08.489994 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 368/686] 10.222.0.61 () {58 vars in 1217 bytes} [Fri Jun 3 13:28:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-311302372 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:28:08.591848 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-702247f6-2613-4e56-9ead-f3dc244413e0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:08.601330 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-702247f6-2613-4e56-9ead-f3dc244413e0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:08.602972 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-702247f6-2613-4e56-9ead-f3dc244413e0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:08.604354 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-702247f6-2613-4e56-9ead-f3dc244413e0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1352 microversion: 2.20 time: 0.351403 Jun 03 13:28:08.605026 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 319/687] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:08 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1352 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:28:09.332598 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a9ab4fb7-9eee-4089-ac12-4e4292442b80 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:09.333108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a9ab4fb7-9eee-4089-ac12-4e4292442b80 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:09.340988 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a9ab4fb7-9eee-4089-ac12-4e4292442b80 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:09.341365 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a9ab4fb7-9eee-4089-ac12-4e4292442b80 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:09.342756 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a9ab4fb7-9eee-4089-ac12-4e4292442b80 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:09.343199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a9ab4fb7-9eee-4089-ac12-4e4292442b80 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:09.428489 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-a9ab4fb7-9eee-4089-ac12-4e4292442b80 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lazy-loading 'services' on Instance uuid 7f916e17-eccc-4c6d-b3cd-9517056abcfc {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:09.596046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a9ab4fb7-9eee-4089-ac12-4e4292442b80 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/os-volume_attachments/333386db-53ba-416f-b0fa-d9a0cfb16fb2" status: 202 len: 0 microversion: 2.1 time: 0.266107 Jun 03 13:28:09.596046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 369/688] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 13:28:09 2022] DELETE /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/os-volume_attachments/333386db-53ba-416f-b0fa-d9a0cfb16fb2 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:28:09.613952 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e0b56a6d-0f3e-4102-aad6-9cafbb86beed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:09.616339 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e0b56a6d-0f3e-4102-aad6-9cafbb86beed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:09.624672 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-268e1379-7102-45a8-bb51-666b5db57356 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:09.625648 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-268e1379-7102-45a8-bb51-666b5db57356 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:09.627121 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e0b56a6d-0f3e-4102-aad6-9cafbb86beed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:09.627711 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e0b56a6d-0f3e-4102-aad6-9cafbb86beed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:09.629020 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e0b56a6d-0f3e-4102-aad6-9cafbb86beed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:09.629678 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e0b56a6d-0f3e-4102-aad6-9cafbb86beed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:09.633260 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-268e1379-7102-45a8-bb51-666b5db57356 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:09.633787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-268e1379-7102-45a8-bb51-666b5db57356 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:09.634785 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-268e1379-7102-45a8-bb51-666b5db57356 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:09.635371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-268e1379-7102-45a8-bb51-666b5db57356 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:09.667456 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e0b56a6d-0f3e-4102-aad6-9cafbb86beed tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066023 Jun 03 13:28:09.668049 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 320/689] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:28:09 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:09.946726 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-268e1379-7102-45a8-bb51-666b5db57356 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:09.955552 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-268e1379-7102-45a8-bb51-666b5db57356 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:09.957452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-268e1379-7102-45a8-bb51-666b5db57356 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:09.958751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-268e1379-7102-45a8-bb51-666b5db57356 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1408 microversion: 2.20 time: 0.339867 Jun 03 13:28:09.960070 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 370/690] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:09 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1408 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:28:10.148926 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-287612d1-e694-4a6b-9bf1-b9203cf28398 req-78070480-8d97-40e2-b7a0-a00c2f6eeca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f51fd4a-3353-43f3-b528-c767e6b916d8", "tag": "173fe60e-b29a-407d-93fa-37787cf955ce"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:10.156955 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-287612d1-e694-4a6b-9bf1-b9203cf28398 req-78070480-8d97-40e2-b7a0-a00c2f6eeca4 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:10.157406 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-287612d1-e694-4a6b-9bf1-b9203cf28398 req-78070480-8d97-40e2-b7a0-a00c2f6eeca4 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:10.172858 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-287612d1-e694-4a6b-9bf1-b9203cf28398 req-78070480-8d97-40e2-b7a0-a00c2f6eeca4 service nova] Creating event network-changed:173fe60e-b29a-407d-93fa-37787cf955ce for instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 on hv-cinder-80135 Jun 03 13:28:10.178353 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-287612d1-e694-4a6b-9bf1-b9203cf28398 req-78070480-8d97-40e2-b7a0-a00c2f6eeca4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034115 Jun 03 13:28:10.179054 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 321/691] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:10.679155 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-56258ae0-7c0e-4d33-b45b-44ec917c3aa7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:10.680173 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-56258ae0-7c0e-4d33-b45b-44ec917c3aa7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:10.686805 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-56258ae0-7c0e-4d33-b45b-44ec917c3aa7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:10.687257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-56258ae0-7c0e-4d33-b45b-44ec917c3aa7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:10.688011 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-56258ae0-7c0e-4d33-b45b-44ec917c3aa7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:10.688632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-56258ae0-7c0e-4d33-b45b-44ec917c3aa7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:10.720017 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-56258ae0-7c0e-4d33-b45b-44ec917c3aa7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045053 Jun 03 13:28:10.720595 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 371/692] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:28:10 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:10.977917 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-47ab85ab-cc3a-458d-91c8-cef182179b3c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:10.978608 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-47ab85ab-cc3a-458d-91c8-cef182179b3c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:10.984832 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-47ab85ab-cc3a-458d-91c8-cef182179b3c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:10.987361 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-47ab85ab-cc3a-458d-91c8-cef182179b3c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:10.987361 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-47ab85ab-cc3a-458d-91c8-cef182179b3c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:10.987361 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-47ab85ab-cc3a-458d-91c8-cef182179b3c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:11.117039 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-47ab85ab-cc3a-458d-91c8-cef182179b3c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:11.125669 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-47ab85ab-cc3a-458d-91c8-cef182179b3c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:11.127171 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-47ab85ab-cc3a-458d-91c8-cef182179b3c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:11.129634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-47ab85ab-cc3a-458d-91c8-cef182179b3c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1408 microversion: 2.20 time: 0.155265 Jun 03 13:28:11.129634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 322/693] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:10 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:28:11.731840 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e4eab0a3-f2c4-42f8-8414-24648b71ff2a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:11.733468 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e4eab0a3-f2c4-42f8-8414-24648b71ff2a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:11.741339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4eab0a3-f2c4-42f8-8414-24648b71ff2a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:11.741784 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4eab0a3-f2c4-42f8-8414-24648b71ff2a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:11.742890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4eab0a3-f2c4-42f8-8414-24648b71ff2a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:11.743335 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4eab0a3-f2c4-42f8-8414-24648b71ff2a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:11.768639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:11.773626 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e4eab0a3-f2c4-42f8-8414-24648b71ff2a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045608 Jun 03 13:28:11.774387 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 372/694] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:28:11 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 03 13:28:11.831591 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e6c842ea-0283-4900-ac38-461567304266 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:11.832088 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e6c842ea-0283-4900-ac38-461567304266 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:11.838519 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e6c842ea-0283-4900-ac38-461567304266 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:11.838872 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e6c842ea-0283-4900-ac38-461567304266 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:11.839627 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e6c842ea-0283-4900-ac38-461567304266 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:11.840060 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e6c842ea-0283-4900-ac38-461567304266 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:11.864022 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e6c842ea-0283-4900-ac38-461567304266 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Going to try to terminate instance {{(pid=118178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:28:11.877965 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:12.114990 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e6c842ea-0283-4900-ac38-461567304266 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 204 len: 0 microversion: 2.1 time: 0.286839 Jun 03 13:28:12.116294 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 323/695] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:28:11 2022] DELETE /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:28:12.125170 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-500cc09c-4161-4539-afc0-a02acdb7fba5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:12.125800 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-500cc09c-4161-4539-afc0-a02acdb7fba5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:12.132843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-500cc09c-4161-4539-afc0-a02acdb7fba5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:12.133287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-500cc09c-4161-4539-afc0-a02acdb7fba5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:12.134035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-500cc09c-4161-4539-afc0-a02acdb7fba5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:12.134467 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-500cc09c-4161-4539-afc0-a02acdb7fba5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:12.147193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dba57c53-8384-4b97-9793-64dfed9a7958 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:12.147916 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dba57c53-8384-4b97-9793-64dfed9a7958 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:12.154054 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dba57c53-8384-4b97-9793-64dfed9a7958 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:12.154501 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dba57c53-8384-4b97-9793-64dfed9a7958 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:12.155314 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dba57c53-8384-4b97-9793-64dfed9a7958 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:12.155718 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dba57c53-8384-4b97-9793-64dfed9a7958 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:12.266209 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-500cc09c-4161-4539-afc0-a02acdb7fba5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:12.274080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-500cc09c-4161-4539-afc0-a02acdb7fba5 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1683 microversion: 2.1 time: 0.153400 Jun 03 13:28:12.274741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 373/696] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:12 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:12.285074 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-dba57c53-8384-4b97-9793-64dfed9a7958 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:12.293573 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-dba57c53-8384-4b97-9793-64dfed9a7958 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:12.295064 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-dba57c53-8384-4b97-9793-64dfed9a7958 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:12.296157 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dba57c53-8384-4b97-9793-64dfed9a7958 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1408 microversion: 2.20 time: 0.153205 Jun 03 13:28:12.296730 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 324/697] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:12 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:28:13.292774 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3a75e1d1-eeeb-4cf1-b557-a61d599be1d7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:13.293309 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3a75e1d1-eeeb-4cf1-b557-a61d599be1d7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:13.299884 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3a75e1d1-eeeb-4cf1-b557-a61d599be1d7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:13.300376 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3a75e1d1-eeeb-4cf1-b557-a61d599be1d7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:13.301142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3a75e1d1-eeeb-4cf1-b557-a61d599be1d7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:13.301583 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3a75e1d1-eeeb-4cf1-b557-a61d599be1d7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:13.314623 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b8a6e240-8d1e-40db-943e-980a3eea857c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:13.315236 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b8a6e240-8d1e-40db-943e-980a3eea857c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:13.317694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=4 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:13.322606 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b8a6e240-8d1e-40db-943e-980a3eea857c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:13.323061 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b8a6e240-8d1e-40db-943e-980a3eea857c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:13.323830 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b8a6e240-8d1e-40db-943e-980a3eea857c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:13.324324 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b8a6e240-8d1e-40db-943e-980a3eea857c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:13.441815 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3a75e1d1-eeeb-4cf1-b557-a61d599be1d7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:13.450850 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3a75e1d1-eeeb-4cf1-b557-a61d599be1d7 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1683 microversion: 2.1 time: 0.162001 Jun 03 13:28:13.451659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 374/698] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:13 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:13.470911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b8a6e240-8d1e-40db-943e-980a3eea857c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:13.479267 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b8a6e240-8d1e-40db-943e-980a3eea857c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:13.480807 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b8a6e240-8d1e-40db-943e-980a3eea857c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:13.481900 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b8a6e240-8d1e-40db-943e-980a3eea857c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1408 microversion: 2.20 time: 0.171152 Jun 03 13:28:13.482456 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 325/699] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:13 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:28:14.469387 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6b5d4828-72eb-494f-9c08-f5f8eada4b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:14.470022 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6b5d4828-72eb-494f-9c08-f5f8eada4b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:14.477374 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6b5d4828-72eb-494f-9c08-f5f8eada4b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:14.477832 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6b5d4828-72eb-494f-9c08-f5f8eada4b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:14.478638 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6b5d4828-72eb-494f-9c08-f5f8eada4b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:14.479079 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6b5d4828-72eb-494f-9c08-f5f8eada4b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:14.501008 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a6b25cdc-391d-415b-a731-c7ae5ade00a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:14.501652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a6b25cdc-391d-415b-a731-c7ae5ade00a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:14.508645 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a6b25cdc-391d-415b-a731-c7ae5ade00a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:14.509132 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a6b25cdc-391d-415b-a731-c7ae5ade00a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:14.509936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a6b25cdc-391d-415b-a731-c7ae5ade00a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:14.510379 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a6b25cdc-391d-415b-a731-c7ae5ade00a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:14.612196 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6b5d4828-72eb-494f-9c08-f5f8eada4b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:14.619724 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6b5d4828-72eb-494f-9c08-f5f8eada4b1b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1683 microversion: 2.1 time: 0.154380 Jun 03 13:28:14.620306 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 375/700] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:14 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:14.641483 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a6b25cdc-391d-415b-a731-c7ae5ade00a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:14.650271 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a6b25cdc-391d-415b-a731-c7ae5ade00a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:14.651845 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a6b25cdc-391d-415b-a731-c7ae5ade00a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:14.652976 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a6b25cdc-391d-415b-a731-c7ae5ade00a6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1408 microversion: 2.20 time: 0.156235 Jun 03 13:28:14.653541 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 326/701] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:14 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:28:15.637612 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-58c286bb-3314-4e81-af1e-0b08dc6b75bc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:15.638312 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-58c286bb-3314-4e81-af1e-0b08dc6b75bc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:15.644969 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-58c286bb-3314-4e81-af1e-0b08dc6b75bc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:15.645352 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-58c286bb-3314-4e81-af1e-0b08dc6b75bc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:15.646121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-58c286bb-3314-4e81-af1e-0b08dc6b75bc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:15.646617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-58c286bb-3314-4e81-af1e-0b08dc6b75bc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:15.673801 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a9ceebd8-a9f9-4fd6-87cb-2fbd9e85731b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:15.675250 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a9ceebd8-a9f9-4fd6-87cb-2fbd9e85731b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:15.684129 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a9ceebd8-a9f9-4fd6-87cb-2fbd9e85731b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:15.684749 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a9ceebd8-a9f9-4fd6-87cb-2fbd9e85731b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:15.685659 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a9ceebd8-a9f9-4fd6-87cb-2fbd9e85731b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:15.686190 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a9ceebd8-a9f9-4fd6-87cb-2fbd9e85731b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:15.724681 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-58c286bb-3314-4e81-af1e-0b08dc6b75bc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:15.732266 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-58c286bb-3314-4e81-af1e-0b08dc6b75bc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1615 microversion: 2.1 time: 0.098723 Jun 03 13:28:15.733247 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 376/702] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:15 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1615 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:15.864723 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-041638bb-c19f-4e20-a95b-5b2a5fcc87fc req-cdfc85cf-2bae-48e6-91f0-2fe91d5c74e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f51fd4a-3353-43f3-b528-c767e6b916d8", "name": "network-vif-plugged", "status": "completed", "tag": "173fe60e-b29a-407d-93fa-37787cf955ce"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:15.873124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-041638bb-c19f-4e20-a95b-5b2a5fcc87fc req-cdfc85cf-2bae-48e6-91f0-2fe91d5c74e2 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:15.873513 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-041638bb-c19f-4e20-a95b-5b2a5fcc87fc req-cdfc85cf-2bae-48e6-91f0-2fe91d5c74e2 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:15.885598 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-041638bb-c19f-4e20-a95b-5b2a5fcc87fc req-cdfc85cf-2bae-48e6-91f0-2fe91d5c74e2 service nova] Creating event network-vif-plugged:173fe60e-b29a-407d-93fa-37787cf955ce for instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 on hv-cinder-80135 Jun 03 13:28:15.890440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-041638bb-c19f-4e20-a95b-5b2a5fcc87fc req-cdfc85cf-2bae-48e6-91f0-2fe91d5c74e2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084611 Jun 03 13:28:15.891061 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 377/703] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:28:15.899011 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a9ceebd8-a9f9-4fd6-87cb-2fbd9e85731b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:15.909773 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a9ceebd8-a9f9-4fd6-87cb-2fbd9e85731b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:15.911614 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a9ceebd8-a9f9-4fd6-87cb-2fbd9e85731b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:15.916538 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a9ceebd8-a9f9-4fd6-87cb-2fbd9e85731b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1408 microversion: 2.20 time: 0.249361 Jun 03 13:28:15.926791 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 327/704] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:15 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:28:15.972512 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:15.977488 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-8280132a-f27c-4b43-9998-fe708317cd6c req-a0b93bea-c046-4396-9ecb-ad5be75328cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f916e17-eccc-4c6d-b3cd-9517056abcfc", "name": "network-vif-deleted", "tag": "24f2a109-5081-4497-ba6a-88eaca5fa11c"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:15.993950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-8280132a-f27c-4b43-9998-fe708317cd6c req-a0b93bea-c046-4396-9ecb-ad5be75328cf service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:15.994395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-8280132a-f27c-4b43-9998-fe708317cd6c req-a0b93bea-c046-4396-9ecb-ad5be75328cf service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:16.016778 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-8280132a-f27c-4b43-9998-fe708317cd6c req-a0b93bea-c046-4396-9ecb-ad5be75328cf service nova] Creating event network-vif-deleted:24f2a109-5081-4497-ba6a-88eaca5fa11c for instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc on hv-cinder-80135 Jun 03 13:28:16.023213 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-8280132a-f27c-4b43-9998-fe708317cd6c req-a0b93bea-c046-4396-9ecb-ad5be75328cf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051363 Jun 03 13:28:16.023894 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 378/705] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:16.575196 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-381217bf-ffdb-445d-9b79-14c7d36d510a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:16.575685 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-381217bf-ffdb-445d-9b79-14c7d36d510a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:16.581859 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-381217bf-ffdb-445d-9b79-14c7d36d510a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:16.582307 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-381217bf-ffdb-445d-9b79-14c7d36d510a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:16.583058 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-381217bf-ffdb-445d-9b79-14c7d36d510a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:16.583485 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-381217bf-ffdb-445d-9b79-14c7d36d510a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:16.670800 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-381217bf-ffdb-445d-9b79-14c7d36d510a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lazy-loading 'services' on Instance uuid 5852e29d-4480-4e14-9e17-d4cccdcb7d1a {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:16.750822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c51ba9db-3930-471c-85e0-14fc432c9a62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:16.751564 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c51ba9db-3930-471c-85e0-14fc432c9a62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:16.753607 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=8 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:16.760706 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c51ba9db-3930-471c-85e0-14fc432c9a62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:16.761159 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c51ba9db-3930-471c-85e0-14fc432c9a62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:16.761931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c51ba9db-3930-471c-85e0-14fc432c9a62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:16.762364 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c51ba9db-3930-471c-85e0-14fc432c9a62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:16.795891 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c51ba9db-3930-471c-85e0-14fc432c9a62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:16.796373 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c51ba9db-3930-471c-85e0-14fc432c9a62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:16.796823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-c51ba9db-3930-471c-85e0-14fc432c9a62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lazy-loading 'fault' on Instance uuid 7f916e17-eccc-4c6d-b3cd-9517056abcfc {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:16.839160 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c51ba9db-3930-471c-85e0-14fc432c9a62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:16.846683 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c51ba9db-3930-471c-85e0-14fc432c9a62 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1331 microversion: 2.1 time: 0.101547 Jun 03 13:28:16.847261 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 379/706] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:16 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:28:16.869967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-381217bf-ffdb-445d-9b79-14c7d36d510a tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments/c3d8b4a7-d231-4088-85e9-f1e3b1bf0201" status: 202 len: 0 microversion: 2.1 time: 0.298633 Jun 03 13:28:16.870902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 328/707] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 13:28:16 2022] DELETE /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments/c3d8b4a7-d231-4088-85e9-f1e3b1bf0201 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:28:16.879699 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6d6941c0-6ae8-4d83-bd89-80c546cf8285 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:16.880718 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6d6941c0-6ae8-4d83-bd89-80c546cf8285 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:16.887543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6d6941c0-6ae8-4d83-bd89-80c546cf8285 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:16.887990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6d6941c0-6ae8-4d83-bd89-80c546cf8285 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:16.888800 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6d6941c0-6ae8-4d83-bd89-80c546cf8285 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:16.889237 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6d6941c0-6ae8-4d83-bd89-80c546cf8285 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:16.921254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6d6941c0-6ae8-4d83-bd89-80c546cf8285 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Jun 03 13:28:16.922071 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 380/708] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:28:16 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:16.935778 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4bd9e24f-744f-4068-8d7e-75428d807454 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:16.936513 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4bd9e24f-744f-4068-8d7e-75428d807454 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:16.944131 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4bd9e24f-744f-4068-8d7e-75428d807454 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:16.944889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4bd9e24f-744f-4068-8d7e-75428d807454 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:16.945667 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4bd9e24f-744f-4068-8d7e-75428d807454 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:16.946102 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4bd9e24f-744f-4068-8d7e-75428d807454 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:17.081294 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4bd9e24f-744f-4068-8d7e-75428d807454 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:17.089661 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4bd9e24f-744f-4068-8d7e-75428d807454 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:17.091178 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4bd9e24f-744f-4068-8d7e-75428d807454 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:17.092331 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4bd9e24f-744f-4068-8d7e-75428d807454 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1408 microversion: 2.20 time: 0.160935 Jun 03 13:28:17.092877 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 329/709] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:16 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:28:17.862669 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-85494c93-fa6a-4416-bef9-9faed10ada6e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:17.863277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-85494c93-fa6a-4416-bef9-9faed10ada6e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:17.869774 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-85494c93-fa6a-4416-bef9-9faed10ada6e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:17.870220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-85494c93-fa6a-4416-bef9-9faed10ada6e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:17.870974 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-85494c93-fa6a-4416-bef9-9faed10ada6e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:17.871410 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-85494c93-fa6a-4416-bef9-9faed10ada6e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:17.902681 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-85494c93-fa6a-4416-bef9-9faed10ada6e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:17.903128 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-85494c93-fa6a-4416-bef9-9faed10ada6e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:17.903583 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-85494c93-fa6a-4416-bef9-9faed10ada6e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lazy-loading 'fault' on Instance uuid 7f916e17-eccc-4c6d-b3cd-9517056abcfc {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:17.933169 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d1072e3e-364e-41ca-9ae6-9ba1f1f0bbff tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:17.934152 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d1072e3e-364e-41ca-9ae6-9ba1f1f0bbff tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:17.941232 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d1072e3e-364e-41ca-9ae6-9ba1f1f0bbff tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:17.941680 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d1072e3e-364e-41ca-9ae6-9ba1f1f0bbff tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:17.941959 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-85494c93-fa6a-4416-bef9-9faed10ada6e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:17.942452 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d1072e3e-364e-41ca-9ae6-9ba1f1f0bbff tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:17.942889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d1072e3e-364e-41ca-9ae6-9ba1f1f0bbff tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:17.950150 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-85494c93-fa6a-4416-bef9-9faed10ada6e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 200 len: 1331 microversion: 2.1 time: 0.091287 Jun 03 13:28:17.950717 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 381/710] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:17 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 1331 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:17.972474 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d1072e3e-364e-41ca-9ae6-9ba1f1f0bbff tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043204 Jun 03 13:28:17.973023 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 330/711] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:28:17 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:28:18.110859 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d21d0b63-fe33-464a-9c82-1af8bfbe5657 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:18.111390 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d21d0b63-fe33-464a-9c82-1af8bfbe5657 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:18.117589 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d21d0b63-fe33-464a-9c82-1af8bfbe5657 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:18.118034 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d21d0b63-fe33-464a-9c82-1af8bfbe5657 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:18.118778 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d21d0b63-fe33-464a-9c82-1af8bfbe5657 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:18.119210 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d21d0b63-fe33-464a-9c82-1af8bfbe5657 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:18.246980 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d21d0b63-fe33-464a-9c82-1af8bfbe5657 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:18.255383 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d21d0b63-fe33-464a-9c82-1af8bfbe5657 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:18.257656 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d21d0b63-fe33-464a-9c82-1af8bfbe5657 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:18.258803 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d21d0b63-fe33-464a-9c82-1af8bfbe5657 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1408 microversion: 2.20 time: 0.151978 Jun 03 13:28:18.259355 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 382/712] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:18 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:28:18.966780 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-bca85ab4-d6b2-43fe-bb1b-d262355aa3a1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:18.967381 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-bca85ab4-d6b2-43fe-bb1b-d262355aa3a1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:18.974094 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bca85ab4-d6b2-43fe-bb1b-d262355aa3a1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:18.975388 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bca85ab4-d6b2-43fe-bb1b-d262355aa3a1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:18.976171 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bca85ab4-d6b2-43fe-bb1b-d262355aa3a1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:18.976624 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bca85ab4-d6b2-43fe-bb1b-d262355aa3a1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:18.985111 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-130ddee2-6541-4990-baa9-1172c0b919f5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:18.986199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-130ddee2-6541-4990-baa9-1172c0b919f5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:18.991562 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-bca85ab4-d6b2-43fe-bb1b-d262355aa3a1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-bca85ab4-d6b2-43fe-bb1b-d262355aa3a1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc HTTP/1.1 Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:28:18.993579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:28:18.995140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:28:18.995140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:28:18.995140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:28:18.995140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:28:18.995140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:28:18.995140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:28:18.995140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:28:18.995140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:28:18.995140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:28:18.995140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:28:18.995140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:28:18.995140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '7f916e17-eccc-4c6d-b3cd-9517056abcfc'} Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:28:18.995998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:28:18.997628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:19.000923 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-bca85ab4-d6b2-43fe-bb1b-d262355aa3a1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 404 to user: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:28:19.001034 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-130ddee2-6541-4990-baa9-1172c0b919f5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:19.001034 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-130ddee2-6541-4990-baa9-1172c0b919f5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:19.001259 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-bca85ab4-d6b2-43fe-bb1b-d262355aa3a1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 404 len: 111 microversion: 2.1 time: 0.031751 Jun 03 13:28:19.001349 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-130ddee2-6541-4990-baa9-1172c0b919f5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:19.001349 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-130ddee2-6541-4990-baa9-1172c0b919f5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:19.001538 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 331/713] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:18 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:28:19.004211 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6c8c8ad7-fc08-4b27-b529-582c57c97450 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '.version_select at 0x7f5bc8110790>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:19.027830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-130ddee2-6541-4990-baa9-1172c0b919f5 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047745 Jun 03 13:28:19.028417 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 383/714] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:28:18 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:19.076746 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6c8c8ad7-fc08-4b27-b529-582c57c97450 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-517165268" status: 202 len: 0 microversion: 2.1 time: 0.076609 Jun 03 13:28:19.077464 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 332/715] 10.222.0.61 () {58 vars in 1217 bytes} [Fri Jun 3 13:28:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-517165268 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:28:19.277644 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d9f84294-ed44-47e4-97e2-8777a0866c88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:19.278232 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d9f84294-ed44-47e4-97e2-8777a0866c88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:19.294549 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d9f84294-ed44-47e4-97e2-8777a0866c88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:19.295203 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d9f84294-ed44-47e4-97e2-8777a0866c88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:19.296014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d9f84294-ed44-47e4-97e2-8777a0866c88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:19.296575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d9f84294-ed44-47e4-97e2-8777a0866c88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:19.448114 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d9f84294-ed44-47e4-97e2-8777a0866c88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:19.456426 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d9f84294-ed44-47e4-97e2-8777a0866c88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:19.457939 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d9f84294-ed44-47e4-97e2-8777a0866c88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:19.459716 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d9f84294-ed44-47e4-97e2-8777a0866c88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1600 microversion: 2.20 time: 0.185626 Jun 03 13:28:19.460491 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 384/716] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:28:19 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1600 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:28:19.477250 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b15195fe-2ab9-4702-96b3-e4a005fea974 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:19.477750 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b15195fe-2ab9-4702-96b3-e4a005fea974 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:19.483758 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b15195fe-2ab9-4702-96b3-e4a005fea974 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:19.484239 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b15195fe-2ab9-4702-96b3-e4a005fea974 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:19.485006 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b15195fe-2ab9-4702-96b3-e4a005fea974 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:19.485441 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b15195fe-2ab9-4702-96b3-e4a005fea974 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:19.588119 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b15195fe-2ab9-4702-96b3-e4a005fea974 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.114838 Jun 03 13:28:19.588831 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 333/717] 10.222.0.61 () {60 vars in 1315 bytes} [Fri Jun 3 13:28:19 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:28:19.904292 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-210bcdc4-17fd-48be-90be-1e34c80ac247 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: .version_select at 0x7f5bc8967ca0>, body: {"keypair": {"name": "tempest-keypair-864643134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoXEerv6CtjYYxptECpmxV3eQZpn2miBblT//Wp/lFDteXk2VIm3nVXw5Bb25nbKtLSTHlhXd3oVAm8fNRLU48LHDkS/Y1eXEsDziaN+wdeQHF8rEViHNIAQevEfMIFzA=="}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:19.918377 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-210bcdc4-17fd-48be-90be-1e34c80ac247 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'key_pairs'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:28:19.920627 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:19.922880 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-210bcdc4-17fd-48be-90be-1e34c80ac247 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for user 267a2b59a70245dfb7ec1b779f7fdd51 and project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'key_pairs'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:28:20.037479 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-210bcdc4-17fd-48be-90be-1e34c80ac247 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136897 Jun 03 13:28:20.038308 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 385/718] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 13:28:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:20.045482 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f3b8e57a-8b35-420d-b53a-12a44094fdb3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:20.046545 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f3b8e57a-8b35-420d-b53a-12a44094fdb3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:20.053691 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f3b8e57a-8b35-420d-b53a-12a44094fdb3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:20.054388 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f3b8e57a-8b35-420d-b53a-12a44094fdb3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:20.055183 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f3b8e57a-8b35-420d-b53a-12a44094fdb3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:20.055625 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f3b8e57a-8b35-420d-b53a-12a44094fdb3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:20.085961 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f3b8e57a-8b35-420d-b53a-12a44094fdb3 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050802 Jun 03 13:28:20.086523 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 334/719] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:28:20 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 03 13:28:20.161647 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e89c62e4-2ef1-4f20-8b76-160bc527206e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:20.162932 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e89c62e4-2ef1-4f20-8b76-160bc527206e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:20.169423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e89c62e4-2ef1-4f20-8b76-160bc527206e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:20.170103 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e89c62e4-2ef1-4f20-8b76-160bc527206e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:20.171067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e89c62e4-2ef1-4f20-8b76-160bc527206e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:20.171500 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e89c62e4-2ef1-4f20-8b76-160bc527206e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:20.201361 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e89c62e4-2ef1-4f20-8b76-160bc527206e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Going to try to terminate instance {{(pid=118179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:28:20.539025 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e89c62e4-2ef1-4f20-8b76-160bc527206e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 204 len: 0 microversion: 2.1 time: 0.381289 Jun 03 13:28:20.541812 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 386/720] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:28:20 2022] DELETE /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:28:20.550061 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-df551560-c496-4bcd-812a-9853c5424d7f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:20.550911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-df551560-c496-4bcd-812a-9853c5424d7f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:20.559610 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-df551560-c496-4bcd-812a-9853c5424d7f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:20.560111 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-df551560-c496-4bcd-812a-9853c5424d7f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:20.560917 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-df551560-c496-4bcd-812a-9853c5424d7f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:20.561417 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-df551560-c496-4bcd-812a-9853c5424d7f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:20.642663 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-14620fd1-fbf4-47f2-94c6-2a3dfdcc7659 req-07369377-1442-41d9-a089-e04e2a65e224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f51fd4a-3353-43f3-b528-c767e6b916d8", "tag": "173fe60e-b29a-407d-93fa-37787cf955ce"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:20.653012 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-14620fd1-fbf4-47f2-94c6-2a3dfdcc7659 req-07369377-1442-41d9-a089-e04e2a65e224 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:20.653454 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-14620fd1-fbf4-47f2-94c6-2a3dfdcc7659 req-07369377-1442-41d9-a089-e04e2a65e224 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:20.667719 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-14620fd1-fbf4-47f2-94c6-2a3dfdcc7659 req-07369377-1442-41d9-a089-e04e2a65e224 service nova] Creating event network-changed:173fe60e-b29a-407d-93fa-37787cf955ce for instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 on hv-cinder-80135 Jun 03 13:28:20.671844 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-14620fd1-fbf4-47f2-94c6-2a3dfdcc7659 req-07369377-1442-41d9-a089-e04e2a65e224 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095955 Jun 03 13:28:20.672487 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 387/721] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:28:20.713634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-df551560-c496-4bcd-812a-9853c5424d7f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:20.722122 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-df551560-c496-4bcd-812a-9853c5424d7f tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1685 microversion: 2.1 time: 0.176706 Jun 03 13:28:20.722940 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 335/722] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:20 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:21.740772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-eccfbae5-5775-4643-acbf-fb9e1a53fe4b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:21.741472 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-eccfbae5-5775-4643-acbf-fb9e1a53fe4b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:21.748500 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-eccfbae5-5775-4643-acbf-fb9e1a53fe4b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:21.749230 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-eccfbae5-5775-4643-acbf-fb9e1a53fe4b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:21.750022 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-eccfbae5-5775-4643-acbf-fb9e1a53fe4b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:21.750453 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-eccfbae5-5775-4643-acbf-fb9e1a53fe4b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:21.949309 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-eccfbae5-5775-4643-acbf-fb9e1a53fe4b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:21.956846 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-eccfbae5-5775-4643-acbf-fb9e1a53fe4b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1685 microversion: 2.1 time: 0.220474 Jun 03 13:28:21.957410 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 388/723] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:21 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1685 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:22.532755 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1146864944", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "933d7ba3-7582-451a-82dc-0b343d5ac36c"}], "security_groups": [{"name": "tempest-securitygroup--31124566"}], "key_name": "tempest-keypair-864643134", "user_data": "}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:22.636247 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.network.neutron [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] validate_networks() for [('933d7ba3-7582-451a-82dc-0b343d5ac36c', None, None, None, None, None)] {{(pid=118178) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:28:22.974145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8a189993-1fa1-4f4e-8421-195f683c4195 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:22.974893 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8a189993-1fa1-4f4e-8421-195f683c4195 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:22.981757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8a189993-1fa1-4f4e-8421-195f683c4195 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:22.982209 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8a189993-1fa1-4f4e-8421-195f683c4195 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:22.982968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8a189993-1fa1-4f4e-8421-195f683c4195 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:22.983398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8a189993-1fa1-4f4e-8421-195f683c4195 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:23.049240 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Flavor limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:28:23.049661 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Image limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:28:23.050265 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Flavor pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:28:23.050678 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Image pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:28:23.051114 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:28:23.060033 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:23.060507 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:23.061310 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:23.061751 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:23.079222 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:28:23.083212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for user 267a2b59a70245dfb7ec1b779f7fdd51 and project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:28:23.093284 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:23.095835 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Going to run 1 instances... {{(pid=118178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:28:23.098172 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:28:23.126089 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8a189993-1fa1-4f4e-8421-195f683c4195 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:23.134481 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8a189993-1fa1-4f4e-8421-195f683c4195 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1685 microversion: 2.1 time: 0.164243 Jun 03 13:28:23.135055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 389/724] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:22 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:28:23.220944 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6291b39f-fc7f-49b5-886a-f055528967dd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.692378 Jun 03 13:28:23.221732 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 336/725] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:28:22 2022] POST /compute/v2.1/servers => generated 400 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:28:23.232121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1959dbe4-18fd-442d-b611-621e491ccb65 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:23.232780 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-1959dbe4-18fd-442d-b611-621e491ccb65 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:23.286384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1959dbe4-18fd-442d-b611-621e491ccb65 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:23.293425 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1959dbe4-18fd-442d-b611-621e491ccb65 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1241 microversion: 2.1 time: 0.065202 Jun 03 13:28:23.294256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 390/726] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:23 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:24.152007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-69841f68-36fc-46d0-ad4f-704d6510f0b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:24.152643 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-69841f68-36fc-46d0-ad4f-704d6510f0b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:24.161222 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-69841f68-36fc-46d0-ad4f-704d6510f0b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:24.161677 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-69841f68-36fc-46d0-ad4f-704d6510f0b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:24.163123 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-69841f68-36fc-46d0-ad4f-704d6510f0b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:24.163715 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-69841f68-36fc-46d0-ad4f-704d6510f0b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:24.310382 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5baa6e04-7c15-4f41-9998-ecf844f0c75f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:24.310954 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5baa6e04-7c15-4f41-9998-ecf844f0c75f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:24.318213 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5baa6e04-7c15-4f41-9998-ecf844f0c75f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:24.319305 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5baa6e04-7c15-4f41-9998-ecf844f0c75f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:24.320042 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5baa6e04-7c15-4f41-9998-ecf844f0c75f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:24.320505 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5baa6e04-7c15-4f41-9998-ecf844f0c75f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:24.324810 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:24.355549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-69841f68-36fc-46d0-ad4f-704d6510f0b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:24.364768 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-69841f68-36fc-46d0-ad4f-704d6510f0b4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1685 microversion: 2.1 time: 0.217009 Jun 03 13:28:24.366077 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 337/727] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:24 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1685 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:24.382526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5baa6e04-7c15-4f41-9998-ecf844f0c75f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:24.390769 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5baa6e04-7c15-4f41-9998-ecf844f0c75f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1245 microversion: 2.1 time: 0.084324 Jun 03 13:28:24.395797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 391/728] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:24 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:25.384666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7ed44b88-d559-44fa-bbb9-fbb33a5c5f8b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:25.385270 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-7ed44b88-d559-44fa-bbb9-fbb33a5c5f8b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:25.393485 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7ed44b88-d559-44fa-bbb9-fbb33a5c5f8b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:25.393932 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7ed44b88-d559-44fa-bbb9-fbb33a5c5f8b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:25.394725 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7ed44b88-d559-44fa-bbb9-fbb33a5c5f8b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:25.396055 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7ed44b88-d559-44fa-bbb9-fbb33a5c5f8b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:25.411055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a7f3a123-8f7c-4838-be0e-dc449db0bd5b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:25.411885 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a7f3a123-8f7c-4838-be0e-dc449db0bd5b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:25.420064 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7f3a123-8f7c-4838-be0e-dc449db0bd5b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:25.420764 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7f3a123-8f7c-4838-be0e-dc449db0bd5b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:25.422039 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7f3a123-8f7c-4838-be0e-dc449db0bd5b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:25.422631 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a7f3a123-8f7c-4838-be0e-dc449db0bd5b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:25.479348 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-7ed44b88-d559-44fa-bbb9-fbb33a5c5f8b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:25.488669 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a7f3a123-8f7c-4838-be0e-dc449db0bd5b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:25.494099 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-7ed44b88-d559-44fa-bbb9-fbb33a5c5f8b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1621 microversion: 2.1 time: 0.114490 Jun 03 13:28:25.495068 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 338/729] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:25 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1621 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:25.503184 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a7f3a123-8f7c-4838-be0e-dc449db0bd5b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1301 microversion: 2.1 time: 0.096000 Jun 03 13:28:25.504001 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 392/730] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:25 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:28:25.954345 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-58ba6e9b-1df6-4fdf-b5e1-384707182a8e req-2dc45799-4b71-409f-bf0b-2d146821f038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5852e29d-4480-4e14-9e17-d4cccdcb7d1a", "name": "network-vif-deleted", "tag": "72222d2c-4db5-4768-b158-b370d5e0b875"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:25.969026 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-58ba6e9b-1df6-4fdf-b5e1-384707182a8e req-2dc45799-4b71-409f-bf0b-2d146821f038 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:25.969784 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-58ba6e9b-1df6-4fdf-b5e1-384707182a8e req-2dc45799-4b71-409f-bf0b-2d146821f038 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:25.992281 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-58ba6e9b-1df6-4fdf-b5e1-384707182a8e req-2dc45799-4b71-409f-bf0b-2d146821f038 service nova] Creating event network-vif-deleted:72222d2c-4db5-4768-b158-b370d5e0b875 for instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a on hv-cinder-80135 Jun 03 13:28:25.998232 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-58ba6e9b-1df6-4fdf-b5e1-384707182a8e req-2dc45799-4b71-409f-bf0b-2d146821f038 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051543 Jun 03 13:28:26.000462 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 339/731] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:26.511156 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-efbf62f7-3501-48fc-a878-334d72222238 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:26.512559 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-efbf62f7-3501-48fc-a878-334d72222238 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:26.520322 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-efbf62f7-3501-48fc-a878-334d72222238 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:26.521333 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-efbf62f7-3501-48fc-a878-334d72222238 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:26.523228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-efbf62f7-3501-48fc-a878-334d72222238 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:26.523728 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-efbf62f7-3501-48fc-a878-334d72222238 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:26.524310 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-83df0308-dde2-48e1-934c-9d2059c7fc0f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:26.525018 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-83df0308-dde2-48e1-934c-9d2059c7fc0f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:26.533848 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-83df0308-dde2-48e1-934c-9d2059c7fc0f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:26.534594 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-83df0308-dde2-48e1-934c-9d2059c7fc0f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:26.538999 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-83df0308-dde2-48e1-934c-9d2059c7fc0f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:26.538999 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-83df0308-dde2-48e1-934c-9d2059c7fc0f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:26.566084 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-efbf62f7-3501-48fc-a878-334d72222238 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:26.566636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-efbf62f7-3501-48fc-a878-334d72222238 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:26.567379 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-efbf62f7-3501-48fc-a878-334d72222238 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lazy-loading 'fault' on Instance uuid 5852e29d-4480-4e14-9e17-d4cccdcb7d1a {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:26.620474 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-efbf62f7-3501-48fc-a878-334d72222238 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:26.630145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-efbf62f7-3501-48fc-a878-334d72222238 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 200 len: 1334 microversion: 2.1 time: 0.122860 Jun 03 13:28:26.630723 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 393/732] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:26 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 1334 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:26.686726 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-83df0308-dde2-48e1-934c-9d2059c7fc0f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:26.695354 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-83df0308-dde2-48e1-934c-9d2059c7fc0f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1365 microversion: 2.1 time: 0.177175 Jun 03 13:28:26.695937 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 340/733] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:26 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:28:27.649158 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e99846a9-05e9-4635-992b-327b956ac359 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:27.649901 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e99846a9-05e9-4635-992b-327b956ac359 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 5852e29d-4480-4e14-9e17-d4cccdcb7d1a] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:27.661421 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e99846a9-05e9-4635-992b-327b956ac359 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:27.663544 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e99846a9-05e9-4635-992b-327b956ac359 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:27.663544 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e99846a9-05e9-4635-992b-327b956ac359 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:27.663755 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e99846a9-05e9-4635-992b-327b956ac359 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:27.677568 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-e99846a9-05e9-4635-992b-327b956ac359 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] HTTP exception thrown: Instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a could not be found. Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e99846a9-05e9-4635-992b-327b956ac359 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Request method failure captured: Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a HTTP/1.1 Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr4hGDdogvcvqQUufQA49jnojsGlzdh6EROqvsENnZprcFlWM-FNGtFOQwPmvK6LhvJ8YyKCMkl8c6MysPOijBxI0Vi2CRs4KJvXzkVBev4KlhDZasL8Z9jVthzq5mfPBxmxK2Unmt23N3AFr0hGobck6dKQgRDP9GpkBAWrirmO7k Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 422fdba5c8474b93b285700c07e9304c Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:28:27.679878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:28:27.681597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_422fdba5c8474b93b285700c07e9304c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:28:27.681597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:28:27.681597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 422fdba5c8474b93b285700c07e9304c Jun 03 13:28:27.681597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:28:27.681597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-ServerRescueNegativeTestJSON-1706662507-project Jun 03 13:28:27.681597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:28:27.681597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:28:27.681597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 308bdbe63af5415d8e817bd9ba2fad3e Jun 03 13:28:27.681597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1706662507-project Jun 03 13:28:27.681597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:28:27.681597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a could not be found. Jun 03 13:28:27.681597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '5852e29d-4480-4e14-9e17-d4cccdcb7d1a'} Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a could not be found. Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:28:27.682519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a could not be found. Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a could not be found. Jun 03 13:28:27.684048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:27.685580 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e99846a9-05e9-4635-992b-327b956ac359 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Returning 404 to user: Instance 5852e29d-4480-4e14-9e17-d4cccdcb7d1a could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:28:27.685580 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e99846a9-05e9-4635-992b-327b956ac359 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a" status: 404 len: 111 microversion: 2.1 time: 0.038190 Jun 03 13:28:27.685580 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 394/734] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:27 2022] GET /compute/v2.1/servers/5852e29d-4480-4e14-9e17-d4cccdcb7d1a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:28:27.694854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c20b9896-9c17-4600-ad41-221a516808e8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '.version_select at 0x7f5bc823a940>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:27.714844 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-fe80a5de-7077-4add-a4b4-247b4a1651c6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:27.715451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-fe80a5de-7077-4add-a4b4-247b4a1651c6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:27.729895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fe80a5de-7077-4add-a4b4-247b4a1651c6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:27.729895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fe80a5de-7077-4add-a4b4-247b4a1651c6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:27.729895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fe80a5de-7077-4add-a4b4-247b4a1651c6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:27.729895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fe80a5de-7077-4add-a4b4-247b4a1651c6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:27.825867 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c20b9896-9c17-4600-ad41-221a516808e8 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-329127318" status: 202 len: 0 microversion: 2.1 time: 0.135479 Jun 03 13:28:27.826421 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 341/735] 10.222.0.61 () {58 vars in 1217 bytes} [Fri Jun 3 13:28:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-329127318 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:28:28.019331 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-acc254e9-31aa-4742-afa6-cc7fdb6f6b59 req-226603ca-88ed-4723-919b-cb7d26267bcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9457ca1-60e7-419b-9c30-10d88085d7ba", "tag": "fe3016e6-27d9-4942-8713-38f60a2301b8"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:28.027751 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-acc254e9-31aa-4742-afa6-cc7fdb6f6b59 req-226603ca-88ed-4723-919b-cb7d26267bcd service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:28.028359 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-acc254e9-31aa-4742-afa6-cc7fdb6f6b59 req-226603ca-88ed-4723-919b-cb7d26267bcd service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:28.040375 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-acc254e9-31aa-4742-afa6-cc7fdb6f6b59 req-226603ca-88ed-4723-919b-cb7d26267bcd service nova] Creating event network-changed:fe3016e6-27d9-4942-8713-38f60a2301b8 for instance a9457ca1-60e7-419b-9c30-10d88085d7ba on hv-cinder-80135 Jun 03 13:28:28.045503 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-acc254e9-31aa-4742-afa6-cc7fdb6f6b59 req-226603ca-88ed-4723-919b-cb7d26267bcd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029949 Jun 03 13:28:28.046201 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 342/736] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:28:28.093283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fe80a5de-7077-4add-a4b4-247b4a1651c6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:28.102131 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-fe80a5de-7077-4add-a4b4-247b4a1651c6 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1365 microversion: 2.1 time: 0.390660 Jun 03 13:28:28.102131 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 395/737] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:27 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1365 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:29.119851 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ad4b21af-163a-44c0-9ebd-144fea30d7f3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:29.120610 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ad4b21af-163a-44c0-9ebd-144fea30d7f3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:29.127007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ad4b21af-163a-44c0-9ebd-144fea30d7f3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:29.127456 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ad4b21af-163a-44c0-9ebd-144fea30d7f3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:29.128236 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ad4b21af-163a-44c0-9ebd-144fea30d7f3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:29.128671 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ad4b21af-163a-44c0-9ebd-144fea30d7f3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:29.147077 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:29.259269 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ad4b21af-163a-44c0-9ebd-144fea30d7f3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:29.266511 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ad4b21af-163a-44c0-9ebd-144fea30d7f3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1365 microversion: 2.1 time: 0.151929 Jun 03 13:28:29.267070 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 343/738] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:29 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:30.282990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-618c1143-bb77-40a9-a9e5-177e8bc2b55a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:30.283622 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-618c1143-bb77-40a9-a9e5-177e8bc2b55a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:30.294174 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-618c1143-bb77-40a9-a9e5-177e8bc2b55a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:30.294174 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-618c1143-bb77-40a9-a9e5-177e8bc2b55a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:30.294174 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-618c1143-bb77-40a9-a9e5-177e8bc2b55a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:30.294174 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-618c1143-bb77-40a9-a9e5-177e8bc2b55a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:30.428579 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-618c1143-bb77-40a9-a9e5-177e8bc2b55a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:30.435998 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-618c1143-bb77-40a9-a9e5-177e8bc2b55a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1365 microversion: 2.1 time: 0.157021 Jun 03 13:28:30.436590 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 396/739] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:30 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:31.360562 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6ce075b2-fe57-41ab-b98e-80b1624a2ea4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:31.361098 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6ce075b2-fe57-41ab-b98e-80b1624a2ea4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:31.367904 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6ce075b2-fe57-41ab-b98e-80b1624a2ea4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:31.368399 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6ce075b2-fe57-41ab-b98e-80b1624a2ea4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:31.369172 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6ce075b2-fe57-41ab-b98e-80b1624a2ea4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:31.369611 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6ce075b2-fe57-41ab-b98e-80b1624a2ea4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:31.394818 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6ce075b2-fe57-41ab-b98e-80b1624a2ea4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Going to try to terminate instance {{(pid=118178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:28:31.452645 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-245a20a8-7d34-4f7a-b011-956326abdbf2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:31.453254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-245a20a8-7d34-4f7a-b011-956326abdbf2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:31.460539 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-245a20a8-7d34-4f7a-b011-956326abdbf2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:31.460964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-245a20a8-7d34-4f7a-b011-956326abdbf2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:31.461769 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-245a20a8-7d34-4f7a-b011-956326abdbf2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:31.462236 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-245a20a8-7d34-4f7a-b011-956326abdbf2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:31.595488 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-245a20a8-7d34-4f7a-b011-956326abdbf2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:31.606279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-245a20a8-7d34-4f7a-b011-956326abdbf2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1365 microversion: 2.1 time: 0.157601 Jun 03 13:28:31.606952 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 397/740] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:31 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:28:31.658788 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6ce075b2-fe57-41ab-b98e-80b1624a2ea4 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 204 len: 0 microversion: 2.1 time: 0.301772 Jun 03 13:28:31.659553 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 344/741] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:28:31 2022] DELETE /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 13:28:31.668543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b4795740-3fb9-4df0-b9a8-a26cc5beb02e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:31.669167 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b4795740-3fb9-4df0-b9a8-a26cc5beb02e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:31.675291 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4795740-3fb9-4df0-b9a8-a26cc5beb02e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:31.675747 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4795740-3fb9-4df0-b9a8-a26cc5beb02e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:31.676551 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4795740-3fb9-4df0-b9a8-a26cc5beb02e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:31.676996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4795740-3fb9-4df0-b9a8-a26cc5beb02e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:31.811244 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b4795740-3fb9-4df0-b9a8-a26cc5beb02e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:31.819525 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b4795740-3fb9-4df0-b9a8-a26cc5beb02e tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1508 microversion: 2.1 time: 0.154902 Jun 03 13:28:31.820026 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 398/742] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:31 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:32.623738 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-33f10777-c07b-4f45-93ba-d390c1679c12 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:32.624811 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-33f10777-c07b-4f45-93ba-d390c1679c12 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:32.631551 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-33f10777-c07b-4f45-93ba-d390c1679c12 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:32.631991 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-33f10777-c07b-4f45-93ba-d390c1679c12 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:32.632781 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-33f10777-c07b-4f45-93ba-d390c1679c12 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:32.633272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-33f10777-c07b-4f45-93ba-d390c1679c12 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:32.762407 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-33f10777-c07b-4f45-93ba-d390c1679c12 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:32.769907 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-33f10777-c07b-4f45-93ba-d390c1679c12 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1365 microversion: 2.1 time: 0.150436 Jun 03 13:28:32.770515 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 345/743] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:32 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:32.837293 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5e277e87-1f51-4290-ac9f-1425f5752b9b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:32.837901 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5e277e87-1f51-4290-ac9f-1425f5752b9b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:32.844233 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5e277e87-1f51-4290-ac9f-1425f5752b9b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:32.844684 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5e277e87-1f51-4290-ac9f-1425f5752b9b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:32.845432 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5e277e87-1f51-4290-ac9f-1425f5752b9b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:32.845871 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5e277e87-1f51-4290-ac9f-1425f5752b9b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:32.977520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5e277e87-1f51-4290-ac9f-1425f5752b9b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:32.984996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5e277e87-1f51-4290-ac9f-1425f5752b9b tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1508 microversion: 2.1 time: 0.152195 Jun 03 13:28:32.985555 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 399/744] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:32 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:33.786833 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-905c9887-6da9-4913-acdf-4f3d9c54aa17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:33.787849 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-905c9887-6da9-4913-acdf-4f3d9c54aa17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:33.789998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:33.800742 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=6 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:33.800742 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-905c9887-6da9-4913-acdf-4f3d9c54aa17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:33.800742 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-905c9887-6da9-4913-acdf-4f3d9c54aa17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:33.800742 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-905c9887-6da9-4913-acdf-4f3d9c54aa17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:33.801335 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-905c9887-6da9-4913-acdf-4f3d9c54aa17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:33.806252 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-7226882a-8039-44e8-bab4-ae8f0315e4b7 req-ac7a1156-f1da-47d3-b400-fa1ceedce4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9457ca1-60e7-419b-9c30-10d88085d7ba", "name": "network-vif-plugged", "status": "completed", "tag": "fe3016e6-27d9-4942-8713-38f60a2301b8"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:33.811646 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=6 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:33.816403 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-7226882a-8039-44e8-bab4-ae8f0315e4b7 req-ac7a1156-f1da-47d3-b400-fa1ceedce4e5 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:33.816561 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-7226882a-8039-44e8-bab4-ae8f0315e4b7 req-ac7a1156-f1da-47d3-b400-fa1ceedce4e5 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:33.829027 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-7226882a-8039-44e8-bab4-ae8f0315e4b7 req-ac7a1156-f1da-47d3-b400-fa1ceedce4e5 service nova] Creating event network-vif-plugged:fe3016e6-27d9-4942-8713-38f60a2301b8 for instance a9457ca1-60e7-419b-9c30-10d88085d7ba on hv-cinder-80135 Jun 03 13:28:33.835084 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-7226882a-8039-44e8-bab4-ae8f0315e4b7 req-ac7a1156-f1da-47d3-b400-fa1ceedce4e5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035697 Jun 03 13:28:33.835771 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 400/745] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:33.971073 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-905c9887-6da9-4913-acdf-4f3d9c54aa17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:33.981958 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-905c9887-6da9-4913-acdf-4f3d9c54aa17 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1365 microversion: 2.1 time: 0.198840 Jun 03 13:28:33.982771 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 346/746] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:33 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:34.005936 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5ab82cde-37ca-4ec3-9587-213eff4f9b64 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:34.007484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5ab82cde-37ca-4ec3-9587-213eff4f9b64 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:34.015163 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ab82cde-37ca-4ec3-9587-213eff4f9b64 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:34.015926 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ab82cde-37ca-4ec3-9587-213eff4f9b64 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:34.016915 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ab82cde-37ca-4ec3-9587-213eff4f9b64 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:34.017550 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5ab82cde-37ca-4ec3-9587-213eff4f9b64 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:34.049696 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-9a0bf9e8-766e-4ff0-a1b9-13433e6433e1 req-7b73177b-a40d-47ad-a18a-d6169f8c50eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2968dd86-2754-4322-aae8-39fa37b9826f", "name": "network-vif-deleted", "tag": "8e15e8ed-2b3b-4de4-b402-39e1c2a41fcd"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:34.059037 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-9a0bf9e8-766e-4ff0-a1b9-13433e6433e1 req-7b73177b-a40d-47ad-a18a-d6169f8c50eb service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:34.059705 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-9a0bf9e8-766e-4ff0-a1b9-13433e6433e1 req-7b73177b-a40d-47ad-a18a-d6169f8c50eb service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:34.072105 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-9a0bf9e8-766e-4ff0-a1b9-13433e6433e1 req-7b73177b-a40d-47ad-a18a-d6169f8c50eb service nova] Creating event network-vif-deleted:8e15e8ed-2b3b-4de4-b402-39e1c2a41fcd for instance 2968dd86-2754-4322-aae8-39fa37b9826f on hv-cinder-80135 Jun 03 13:28:34.077531 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-9a0bf9e8-766e-4ff0-a1b9-13433e6433e1 req-7b73177b-a40d-47ad-a18a-d6169f8c50eb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032236 Jun 03 13:28:34.078128 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 347/747] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:34.089433 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5ab82cde-37ca-4ec3-9587-213eff4f9b64 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:34.097091 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5ab82cde-37ca-4ec3-9587-213eff4f9b64 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1466 microversion: 2.1 time: 0.098526 Jun 03 13:28:34.097656 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 401/748] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:33 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1466 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:35.000111 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4f50d505-c26e-4c01-a0f8-0bce102c756e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:35.000858 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4f50d505-c26e-4c01-a0f8-0bce102c756e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:35.008399 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4f50d505-c26e-4c01-a0f8-0bce102c756e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:35.008879 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4f50d505-c26e-4c01-a0f8-0bce102c756e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:35.009687 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4f50d505-c26e-4c01-a0f8-0bce102c756e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:35.010126 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4f50d505-c26e-4c01-a0f8-0bce102c756e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:35.114434 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-aaa13080-692d-4101-a911-1594566304a0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:35.115137 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-aaa13080-692d-4101-a911-1594566304a0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:35.122484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aaa13080-692d-4101-a911-1594566304a0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:35.123034 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aaa13080-692d-4101-a911-1594566304a0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:35.123941 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aaa13080-692d-4101-a911-1594566304a0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:35.124688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aaa13080-692d-4101-a911-1594566304a0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:35.157175 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aaa13080-692d-4101-a911-1594566304a0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:35.157640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aaa13080-692d-4101-a911-1594566304a0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:35.157793 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4f50d505-c26e-4c01-a0f8-0bce102c756e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:35.158093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-aaa13080-692d-4101-a911-1594566304a0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lazy-loading 'fault' on Instance uuid 2968dd86-2754-4322-aae8-39fa37b9826f {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:35.169548 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4f50d505-c26e-4c01-a0f8-0bce102c756e tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1365 microversion: 2.1 time: 0.174096 Jun 03 13:28:35.170137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 348/749] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:34 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:35.200701 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-aaa13080-692d-4101-a911-1594566304a0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:35.211941 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-aaa13080-692d-4101-a911-1594566304a0 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1311 microversion: 2.1 time: 0.101341 Jun 03 13:28:35.212532 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 402/750] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:35 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:28:36.186165 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f2576c57-b22f-4e83-aed5-7553d8ccfa58 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:36.186784 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f2576c57-b22f-4e83-aed5-7553d8ccfa58 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:36.193325 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f2576c57-b22f-4e83-aed5-7553d8ccfa58 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:36.193781 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f2576c57-b22f-4e83-aed5-7553d8ccfa58 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:36.195637 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f2576c57-b22f-4e83-aed5-7553d8ccfa58 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:36.196067 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f2576c57-b22f-4e83-aed5-7553d8ccfa58 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:36.230632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2ff36e9f-78f1-4fea-9d86-fa9186035200 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:36.231251 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2ff36e9f-78f1-4fea-9d86-fa9186035200 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:36.237891 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2ff36e9f-78f1-4fea-9d86-fa9186035200 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:36.238342 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2ff36e9f-78f1-4fea-9d86-fa9186035200 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:36.239122 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2ff36e9f-78f1-4fea-9d86-fa9186035200 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:36.239563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2ff36e9f-78f1-4fea-9d86-fa9186035200 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:36.271452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2ff36e9f-78f1-4fea-9d86-fa9186035200 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:36.271814 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2ff36e9f-78f1-4fea-9d86-fa9186035200 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:36.272365 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-2ff36e9f-78f1-4fea-9d86-fa9186035200 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lazy-loading 'fault' on Instance uuid 2968dd86-2754-4322-aae8-39fa37b9826f {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:36.320253 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2ff36e9f-78f1-4fea-9d86-fa9186035200 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:36.328446 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2ff36e9f-78f1-4fea-9d86-fa9186035200 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 200 len: 1311 microversion: 2.1 time: 0.101727 Jun 03 13:28:36.329274 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 403/751] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:36 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:28:36.341409 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f2576c57-b22f-4e83-aed5-7553d8ccfa58 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:36.348996 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f2576c57-b22f-4e83-aed5-7553d8ccfa58 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1555 microversion: 2.1 time: 0.166691 Jun 03 13:28:36.349600 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 349/752] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:36 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:36.372065 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f3f458b0-8c52-4271-9f3c-208a60d89c57 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:36.372587 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f3f458b0-8c52-4271-9f3c-208a60d89c57 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:36.378794 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f3f458b0-8c52-4271-9f3c-208a60d89c57 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:36.379243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f3f458b0-8c52-4271-9f3c-208a60d89c57 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:36.379997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f3f458b0-8c52-4271-9f3c-208a60d89c57 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:36.380468 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f3f458b0-8c52-4271-9f3c-208a60d89c57 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:36.457113 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f3f458b0-8c52-4271-9f3c-208a60d89c57 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088877 Jun 03 13:28:36.457702 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 404/753] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 13:28:36 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:37.217606 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dec9dd0a-564b-4fb0-b999-131794205766 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-724337416"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:37.218219 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dec9dd0a-564b-4fb0-b999-131794205766 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:37.224752 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dec9dd0a-564b-4fb0-b999-131794205766 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.226443 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dec9dd0a-564b-4fb0-b999-131794205766 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.226576 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dec9dd0a-564b-4fb0-b999-131794205766 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.226984 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dec9dd0a-564b-4fb0-b999-131794205766 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.346164 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-34d8f5b1-6bd2-4193-8776-21eb9eb9989c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:37.346709 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-34d8f5b1-6bd2-4193-8776-21eb9eb9989c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 2968dd86-2754-4322-aae8-39fa37b9826f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:37.354345 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-34d8f5b1-6bd2-4193-8776-21eb9eb9989c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.355064 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-34d8f5b1-6bd2-4193-8776-21eb9eb9989c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.355972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-34d8f5b1-6bd2-4193-8776-21eb9eb9989c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.356452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-34d8f5b1-6bd2-4193-8776-21eb9eb9989c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.356748 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.network.security_group_api [None req-dec9dd0a-564b-4fb0-b999-131794205766 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Removing security group 743329e8-004b-493e-a3b8-61982c0ca6dd from port 6643f089-18b4-4d4c-8781-ba618ecca2fe Jun 03 13:28:37.370844 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-34d8f5b1-6bd2-4193-8776-21eb9eb9989c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] HTTP exception thrown: Instance 2968dd86-2754-4322-aae8-39fa37b9826f could not be found. Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-34d8f5b1-6bd2-4193-8776-21eb9eb9989c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Request method failure captured: Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f HTTP/1.1 Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr4hGDdogvcvqQUufQA49jnojsGlzdh6EROqvsENnZprcFlWM-FNGtFOQwPmvK6LhvJ8YyKCMkl8c6MysPOijBxI0Vi2CRs4KJvXzkVBev4KlhDZasL8Z9jVthzq5mfPBxmxK2Unmt23N3AFr0hGobck6dKQgRDP9GpkBAWrirmO7k Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 422fdba5c8474b93b285700c07e9304c Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:28:37.372753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:28:37.374015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_422fdba5c8474b93b285700c07e9304c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:28:37.374015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:28:37.374015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 422fdba5c8474b93b285700c07e9304c Jun 03 13:28:37.374015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:28:37.374015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-ServerRescueNegativeTestJSON-1706662507-project Jun 03 13:28:37.374015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:28:37.374015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:28:37.374015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 308bdbe63af5415d8e817bd9ba2fad3e Jun 03 13:28:37.374015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1706662507-project Jun 03 13:28:37.374015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:28:37.374015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 2968dd86-2754-4322-aae8-39fa37b9826f could not be found. Jun 03 13:28:37.374015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '2968dd86-2754-4322-aae8-39fa37b9826f'} Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2968dd86-2754-4322-aae8-39fa37b9826f could not be found. Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:28:37.375108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2968dd86-2754-4322-aae8-39fa37b9826f could not be found. Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2968dd86-2754-4322-aae8-39fa37b9826f could not be found. Jun 03 13:28:37.376287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:37.381608 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-34d8f5b1-6bd2-4193-8776-21eb9eb9989c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Returning 404 to user: Instance 2968dd86-2754-4322-aae8-39fa37b9826f could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:28:37.381608 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-34d8f5b1-6bd2-4193-8776-21eb9eb9989c tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f" status: 404 len: 111 microversion: 2.1 time: 0.031960 Jun 03 13:28:37.381608 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 405/754] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:37 2022] GET /compute/v2.1/servers/2968dd86-2754-4322-aae8-39fa37b9826f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:28:37.383029 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f54b6a4e-8880-4b1a-941e-7f9a4454db29 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:37.383535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f54b6a4e-8880-4b1a-941e-7f9a4454db29 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:37.389750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f54b6a4e-8880-4b1a-941e-7f9a4454db29 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.390203 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f54b6a4e-8880-4b1a-941e-7f9a4454db29 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.390978 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f54b6a4e-8880-4b1a-941e-7f9a4454db29 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.391418 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f54b6a4e-8880-4b1a-941e-7f9a4454db29 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.423639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f54b6a4e-8880-4b1a-941e-7f9a4454db29 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Going to try to terminate instance {{(pid=118179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:28:37.738357 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f54b6a4e-8880-4b1a-941e-7f9a4454db29 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "DELETE /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 204 len: 0 microversion: 2.1 time: 0.358931 Jun 03 13:28:37.742530 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 406/755] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:28:37 2022] DELETE /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:28:37.744850 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-7a22e4c2-3b49-4062-8ba4-40ae6442b828 req-69fe5e37-e2da-4a0c-8c23-8c8533b37930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9457ca1-60e7-419b-9c30-10d88085d7ba", "tag": "fe3016e6-27d9-4942-8713-38f60a2301b8"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:37.753072 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-7a22e4c2-3b49-4062-8ba4-40ae6442b828 req-69fe5e37-e2da-4a0c-8c23-8c8533b37930 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.755930 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-7a22e4c2-3b49-4062-8ba4-40ae6442b828 req-69fe5e37-e2da-4a0c-8c23-8c8533b37930 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.765587 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-7a22e4c2-3b49-4062-8ba4-40ae6442b828 req-69fe5e37-e2da-4a0c-8c23-8c8533b37930 service nova] Creating event network-changed:fe3016e6-27d9-4942-8713-38f60a2301b8 for instance a9457ca1-60e7-419b-9c30-10d88085d7ba on hv-cinder-80135 Jun 03 13:28:37.770315 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-7a22e4c2-3b49-4062-8ba4-40ae6442b828 req-69fe5e37-e2da-4a0c-8c23-8c8533b37930 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029970 Jun 03 13:28:37.773034 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 407/756] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:37.779441 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-306747f0-a30d-47f4-9a3d-bb2ad0665e96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:37.780269 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-306747f0-a30d-47f4-9a3d-bb2ad0665e96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:37.789167 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-306747f0-a30d-47f4-9a3d-bb2ad0665e96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.789627 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-306747f0-a30d-47f4-9a3d-bb2ad0665e96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.790483 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-306747f0-a30d-47f4-9a3d-bb2ad0665e96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.791035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-306747f0-a30d-47f4-9a3d-bb2ad0665e96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.795926 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:37.844189 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dec9dd0a-564b-4fb0-b999-131794205766 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "POST /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/action" status: 202 len: 0 microversion: 2.1 time: 0.630406 Jun 03 13:28:37.845063 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 350/757] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:28:37 2022] POST /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/action => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:28:37.860749 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-60280d86-9f66-4250-83e9-56c4a66c5fc2 req-806f2c25-d733-4898-ba51-0acfbfad2c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfaaead1-3faf-4b34-a756-3d1cc7e7d19d", "tag": "6643f089-18b4-4d4c-8781-ba618ecca2fe"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:37.875800 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-60280d86-9f66-4250-83e9-56c4a66c5fc2 req-806f2c25-d733-4898-ba51-0acfbfad2c06 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.882582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-60280d86-9f66-4250-83e9-56c4a66c5fc2 req-806f2c25-d733-4898-ba51-0acfbfad2c06 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.909638 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-60280d86-9f66-4250-83e9-56c4a66c5fc2 req-806f2c25-d733-4898-ba51-0acfbfad2c06 service nova] Creating event network-changed:6643f089-18b4-4d4c-8781-ba618ecca2fe for instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d on hv-cinder-80135 Jun 03 13:28:37.926102 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-60280d86-9f66-4250-83e9-56c4a66c5fc2 req-806f2c25-d733-4898-ba51-0acfbfad2c06 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067576 Jun 03 13:28:37.926102 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 351/758] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:38.007194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-306747f0-a30d-47f4-9a3d-bb2ad0665e96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:38.015618 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-306747f0-a30d-47f4-9a3d-bb2ad0665e96 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.240229 Jun 03 13:28:38.016570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 408/759] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:37 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:39.035674 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dad691b6-c576-4ad0-a9c6-dd077396fa38 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:39.036418 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dad691b6-c576-4ad0-a9c6-dd077396fa38 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:39.044509 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dad691b6-c576-4ad0-a9c6-dd077396fa38 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:39.044955 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dad691b6-c576-4ad0-a9c6-dd077396fa38 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:39.045718 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dad691b6-c576-4ad0-a9c6-dd077396fa38 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:39.046150 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dad691b6-c576-4ad0-a9c6-dd077396fa38 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:39.099691 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3421aef5-b6d9-49e1-95e1-f8a8bfec35f9 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:39.100318 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3421aef5-b6d9-49e1-95e1-f8a8bfec35f9 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:39.107393 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3421aef5-b6d9-49e1-95e1-f8a8bfec35f9 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:39.107986 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3421aef5-b6d9-49e1-95e1-f8a8bfec35f9 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:39.108883 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3421aef5-b6d9-49e1-95e1-f8a8bfec35f9 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:39.109408 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3421aef5-b6d9-49e1-95e1-f8a8bfec35f9 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:39.200446 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-3421aef5-b6d9-49e1-95e1-f8a8bfec35f9 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lazy-loading 'services' on Instance uuid cfaaead1-3faf-4b34-a756-3d1cc7e7d19d {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:39.200806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-dad691b6-c576-4ad0-a9c6-dd077396fa38 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:39.210446 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dad691b6-c576-4ad0-a9c6-dd077396fa38 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.179660 Jun 03 13:28:39.211214 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 352/760] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:39 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:39.406057 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3421aef5-b6d9-49e1-95e1-f8a8bfec35f9 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments/604ab98b-523f-43e7-9acf-30f74b3d830b" status: 202 len: 0 microversion: 2.1 time: 0.310166 Jun 03 13:28:39.406644 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 409/761] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 13:28:39 2022] DELETE /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments/604ab98b-523f-43e7-9acf-30f74b3d830b => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 13:28:39.415773 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e4eaf657-1c3d-44c6-bbaa-8bf3bc1abd79 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:39.420833 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e4eaf657-1c3d-44c6-bbaa-8bf3bc1abd79 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:39.422703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e4eaf657-1c3d-44c6-bbaa-8bf3bc1abd79 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:39.423149 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e4eaf657-1c3d-44c6-bbaa-8bf3bc1abd79 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:39.423911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e4eaf657-1c3d-44c6-bbaa-8bf3bc1abd79 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:39.424375 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e4eaf657-1c3d-44c6-bbaa-8bf3bc1abd79 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:39.454670 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e4eaf657-1c3d-44c6-bbaa-8bf3bc1abd79 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043527 Jun 03 13:28:39.455158 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 353/762] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:28:39 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:28:39.786712 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-2b72098a-5f4f-4515-9770-e48bbee2e954 req-09695810-d0c2-4cb7-afb9-42c9b6988f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfaaead1-3faf-4b34-a756-3d1cc7e7d19d", "tag": "6643f089-18b4-4d4c-8781-ba618ecca2fe"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:39.796030 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-2b72098a-5f4f-4515-9770-e48bbee2e954 req-09695810-d0c2-4cb7-afb9-42c9b6988f92 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:39.796520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-2b72098a-5f4f-4515-9770-e48bbee2e954 req-09695810-d0c2-4cb7-afb9-42c9b6988f92 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:39.808683 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-2b72098a-5f4f-4515-9770-e48bbee2e954 req-09695810-d0c2-4cb7-afb9-42c9b6988f92 service nova] Creating event network-changed:6643f089-18b4-4d4c-8781-ba618ecca2fe for instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d on hv-cinder-80135 Jun 03 13:28:39.813692 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-2b72098a-5f4f-4515-9770-e48bbee2e954 req-09695810-d0c2-4cb7-afb9-42c9b6988f92 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031571 Jun 03 13:28:39.814277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 410/763] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:40.226706 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6fa076de-84ca-46ef-ac5d-2c8aab487164 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:40.227318 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6fa076de-84ca-46ef-ac5d-2c8aab487164 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:40.233817 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6fa076de-84ca-46ef-ac5d-2c8aab487164 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:40.234269 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6fa076de-84ca-46ef-ac5d-2c8aab487164 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:40.235029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6fa076de-84ca-46ef-ac5d-2c8aab487164 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:40.235467 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6fa076de-84ca-46ef-ac5d-2c8aab487164 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:40.362237 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6fa076de-84ca-46ef-ac5d-2c8aab487164 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:40.370462 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6fa076de-84ca-46ef-ac5d-2c8aab487164 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.147592 Jun 03 13:28:40.371031 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 354/764] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:40 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:40.467718 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3739b3ad-2500-43e0-a68f-7df17de74915 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:40.468765 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3739b3ad-2500-43e0-a68f-7df17de74915 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:40.475372 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3739b3ad-2500-43e0-a68f-7df17de74915 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:40.475817 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3739b3ad-2500-43e0-a68f-7df17de74915 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:40.476598 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3739b3ad-2500-43e0-a68f-7df17de74915 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:40.477032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3739b3ad-2500-43e0-a68f-7df17de74915 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:40.506044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3739b3ad-2500-43e0-a68f-7df17de74915 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042562 Jun 03 13:28:40.506595 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 411/765] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:28:40 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:41.387651 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-445019ad-a842-42d1-b618-14f7a3476097 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:41.391907 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-445019ad-a842-42d1-b618-14f7a3476097 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:41.398658 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-445019ad-a842-42d1-b618-14f7a3476097 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:41.405730 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-445019ad-a842-42d1-b618-14f7a3476097 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:41.405730 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-445019ad-a842-42d1-b618-14f7a3476097 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:41.405730 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-445019ad-a842-42d1-b618-14f7a3476097 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:41.518829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9e727e4f-5eb6-45f0-938d-e2d149bacb0a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:41.519910 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9e727e4f-5eb6-45f0-938d-e2d149bacb0a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:41.527281 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9e727e4f-5eb6-45f0-938d-e2d149bacb0a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:41.527821 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9e727e4f-5eb6-45f0-938d-e2d149bacb0a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:41.528729 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9e727e4f-5eb6-45f0-938d-e2d149bacb0a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:41.529241 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9e727e4f-5eb6-45f0-938d-e2d149bacb0a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:41.558658 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9e727e4f-5eb6-45f0-938d-e2d149bacb0a tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043926 Jun 03 13:28:41.559143 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 412/766] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:28:41 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 03 13:28:41.570437 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f9229c32-29ea-4534-96c7-326ca57c7359 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:41.571178 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f9229c32-29ea-4534-96c7-326ca57c7359 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:41.579647 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f9229c32-29ea-4534-96c7-326ca57c7359 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:41.580341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f9229c32-29ea-4534-96c7-326ca57c7359 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:41.581180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f9229c32-29ea-4534-96c7-326ca57c7359 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:41.581628 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f9229c32-29ea-4534-96c7-326ca57c7359 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:41.685006 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-f9229c32-29ea-4534-96c7-326ca57c7359 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] HTTP exception thrown: Instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d is not attached to volume 604ab98b-523f-43e7-9acf-30f74b3d830b Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f9229c32-29ea-4534-96c7-326ca57c7359 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Request method failure captured: Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: DELETE /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments/604ab98b-523f-43e7-9acf-30f74b3d830b HTTP/1.1 Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgt98PWoWOIxwfgGMyJEY2IiKR_Kr6kjIQ4GBC88e1zaZ_XxYP4rFPXgoIKZhw0U5XbgKDs8Q5E9pJTI4eqIM3pFgMdli_EfHkiKnsY3YHbpP-DXXG7IRmJ_Dklbp-VDIG8OFN40QBQcqToMOJOGKuUUcc_2LCewb3sbCOnqhA5kN4A Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 03432cb8c28c46fba16dc9f88d648d11 Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-TestMinimumBasicScenario-826218523 Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:28:41.697145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:28:41.698820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/03432cb8c28c46fba16dc9f88d648d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/03432cb8c28c46fba16dc9f88d648d11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_03432cb8c28c46fba16dc9f88d648d11", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/03432cb8c28c46fba16dc9f88d648d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:28:41.698820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-TestMinimumBasicScenario-826218523 Jun 03 13:28:41.698820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 03432cb8c28c46fba16dc9f88d648d11 Jun 03 13:28:41.698820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-TestMinimumBasicScenario-826218523 Jun 03 13:28:41.698820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-TestMinimumBasicScenario-826218523-project Jun 03 13:28:41.698820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:28:41.698820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:28:41.698820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 4d0490962ec743048ef924340c93de20 Jun 03 13:28:41.698820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-TestMinimumBasicScenario-826218523-project Jun 03 13:28:41.698820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:28:41.698820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d is not attached to volume 604ab98b-523f-43e7-9acf-30f74b3d830b Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'server_id': 'cfaaead1-3faf-4b34-a756-3d1cc7e7d19d', 'id': '604ab98b-523f-43e7-9acf-30f74b3d830b'} Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 604ab98b-523f-43e7-9acf-30f74b3d830b. Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:28:41.699673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d is not attached to volume 604ab98b-523f-43e7-9acf-30f74b3d830b Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d is not attached to volume 604ab98b-523f-43e7-9acf-30f74b3d830b Jun 03 13:28:41.701032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:41.703813 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f9229c32-29ea-4534-96c7-326ca57c7359 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Returning 404 to user: Instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d is not attached to volume 604ab98b-523f-43e7-9acf-30f74b3d830b {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:28:41.704921 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f9229c32-29ea-4534-96c7-326ca57c7359 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments/604ab98b-523f-43e7-9acf-30f74b3d830b" status: 404 len: 154 microversion: 2.1 time: 0.140047 Jun 03 13:28:41.705989 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 413/767] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 13:28:41 2022] DELETE /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d/os-volume_attachments/604ab98b-523f-43e7-9acf-30f74b3d830b => generated 154 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:28:41.720588 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-445019ad-a842-42d1-b618-14f7a3476097 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308bdbe63af5415d8e817bd9ba2fad3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422fdba5c8474b93b285700c07e9304c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:41.731926 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-445019ad-a842-42d1-b618-14f7a3476097 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 200 len: 1522 microversion: 2.1 time: 0.348759 Jun 03 13:28:41.732821 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 355/768] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:41 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:41.831189 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-673c8254-14e5-4d86-9123-7b2cfed7c37e req-e1eb6007-c307-4f9b-ac8d-f87bb0d75f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c52831-b2e0-4fb4-8aa7-6e99a89a3f08", "name": "network-vif-deleted", "tag": "620412f0-e4fb-418a-adb1-ed5a33d57981"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:41.844070 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-673c8254-14e5-4d86-9123-7b2cfed7c37e req-e1eb6007-c307-4f9b-ac8d-f87bb0d75f88 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:41.844564 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-673c8254-14e5-4d86-9123-7b2cfed7c37e req-e1eb6007-c307-4f9b-ac8d-f87bb0d75f88 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:41.857518 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-673c8254-14e5-4d86-9123-7b2cfed7c37e req-e1eb6007-c307-4f9b-ac8d-f87bb0d75f88 service nova] Creating event network-vif-deleted:620412f0-e4fb-418a-adb1-ed5a33d57981 for instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 on hv-cinder-80135 Jun 03 13:28:41.863736 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-673c8254-14e5-4d86-9123-7b2cfed7c37e req-e1eb6007-c307-4f9b-ac8d-f87bb0d75f88 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037316 Jun 03 13:28:41.864670 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 414/769] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:42.748368 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8e384d8a-7eab-4333-ba1e-eb4e731d06b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:42.748965 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8e384d8a-7eab-4333-ba1e-eb4e731d06b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] [instance: 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:42.755662 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e384d8a-7eab-4333-ba1e-eb4e731d06b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:42.756112 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e384d8a-7eab-4333-ba1e-eb4e731d06b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:42.756928 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e384d8a-7eab-4333-ba1e-eb4e731d06b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:42.757349 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e384d8a-7eab-4333-ba1e-eb4e731d06b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:42.770914 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-8e384d8a-7eab-4333-ba1e-eb4e731d06b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] HTTP exception thrown: Instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 could not be found. Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8e384d8a-7eab-4333-ba1e-eb4e731d06b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Request method failure captured: Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 HTTP/1.1 Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgr4hGDdogvcvqQUufQA49jnojsGlzdh6EROqvsENnZprcFlWM-FNGtFOQwPmvK6LhvJ8YyKCMkl8c6MysPOijBxI0Vi2CRs4KJvXzkVBev4KlhDZasL8Z9jVthzq5mfPBxmxK2Unmt23N3AFr0hGobck6dKQgRDP9GpkBAWrirmO7k Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 422fdba5c8474b93b285700c07e9304c Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:28:42.772707 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:28:42.774453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_422fdba5c8474b93b285700c07e9304c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/422fdba5c8474b93b285700c07e9304c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:28:42.774453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:28:42.774453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 422fdba5c8474b93b285700c07e9304c Jun 03 13:28:42.774453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1706662507 Jun 03 13:28:42.774453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-ServerRescueNegativeTestJSON-1706662507-project Jun 03 13:28:42.774453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:28:42.774453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:28:42.774453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 308bdbe63af5415d8e817bd9ba2fad3e Jun 03 13:28:42.774453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1706662507-project Jun 03 13:28:42.774453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:28:42.774453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 could not be found. Jun 03 13:28:42.774453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '13c52831-b2e0-4fb4-8aa7-6e99a89a3f08'} Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 could not be found. Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:28:42.775854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 could not be found. Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 could not be found. Jun 03 13:28:42.777554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:42.779005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8e384d8a-7eab-4333-ba1e-eb4e731d06b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] Returning 404 to user: Instance 13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:28:42.779005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8e384d8a-7eab-4333-ba1e-eb4e731d06b9 tempest-ServerRescueNegativeTestJSON-1706662507 tempest-ServerRescueNegativeTestJSON-1706662507-project] 10.222.0.61 "GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08" status: 404 len: 111 microversion: 2.1 time: 0.029759 Jun 03 13:28:42.779005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 356/770] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:42 2022] GET /compute/v2.1/servers/13c52831-b2e0-4fb4-8aa7-6e99a89a3f08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:28:42.966490 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e4187f69-9cc1-4870-a0fd-149d313ec0b0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:42.967170 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e4187f69-9cc1-4870-a0fd-149d313ec0b0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:42.973932 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4187f69-9cc1-4870-a0fd-149d313ec0b0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:42.974383 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4187f69-9cc1-4870-a0fd-149d313ec0b0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:42.975142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4187f69-9cc1-4870-a0fd-149d313ec0b0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:42.975579 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4187f69-9cc1-4870-a0fd-149d313ec0b0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:43.001715 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e4187f69-9cc1-4870-a0fd-149d313ec0b0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Going to try to terminate instance {{(pid=118179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:28:43.213381 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e4187f69-9cc1-4870-a0fd-149d313ec0b0 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 204 len: 0 microversion: 2.1 time: 0.251122 Jun 03 13:28:43.214197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 415/771] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:28:42 2022] DELETE /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:28:43.222547 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f9cd589d-825d-484e-a53b-d85549baebc5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:43.223163 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f9cd589d-825d-484e-a53b-d85549baebc5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:43.231458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9cd589d-825d-484e-a53b-d85549baebc5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:43.231903 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9cd589d-825d-484e-a53b-d85549baebc5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:43.232689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9cd589d-825d-484e-a53b-d85549baebc5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:43.233283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9cd589d-825d-484e-a53b-d85549baebc5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:43.370782 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f9cd589d-825d-484e-a53b-d85549baebc5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:43.378515 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f9cd589d-825d-484e-a53b-d85549baebc5 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1554 microversion: 2.1 time: 0.159913 Jun 03 13:28:43.379080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 357/772] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:43 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:44.397445 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a668fbca-ff8d-4f94-bcde-ffaf076ccdaa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:44.398294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a668fbca-ff8d-4f94-bcde-ffaf076ccdaa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:44.405160 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a668fbca-ff8d-4f94-bcde-ffaf076ccdaa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:44.405738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a668fbca-ff8d-4f94-bcde-ffaf076ccdaa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:44.406638 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a668fbca-ff8d-4f94-bcde-ffaf076ccdaa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:44.407170 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a668fbca-ff8d-4f94-bcde-ffaf076ccdaa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:44.630346 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a668fbca-ff8d-4f94-bcde-ffaf076ccdaa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:44.638685 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a668fbca-ff8d-4f94-bcde-ffaf076ccdaa tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1554 microversion: 2.1 time: 0.245814 Jun 03 13:28:44.639486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 416/773] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:44 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1554 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:45.656921 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0e5a294c-62e9-4f7b-9c69-50bd53dfd7c8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:45.657623 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0e5a294c-62e9-4f7b-9c69-50bd53dfd7c8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:45.664866 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0e5a294c-62e9-4f7b-9c69-50bd53dfd7c8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:45.665743 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0e5a294c-62e9-4f7b-9c69-50bd53dfd7c8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:45.666795 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0e5a294c-62e9-4f7b-9c69-50bd53dfd7c8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:45.667361 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0e5a294c-62e9-4f7b-9c69-50bd53dfd7c8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:46.022443 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0e5a294c-62e9-4f7b-9c69-50bd53dfd7c8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:46.032917 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0e5a294c-62e9-4f7b-9c69-50bd53dfd7c8 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1554 microversion: 2.1 time: 0.380045 Jun 03 13:28:46.047292 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 358/774] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:45 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1554 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:46.455319 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-99537948-7b6c-421b-9f99-e2a651ecc150 req-c805f14f-9d92-4ab9-a9fc-de55adde374c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfaaead1-3faf-4b34-a756-3d1cc7e7d19d", "name": "network-vif-deleted", "tag": "6643f089-18b4-4d4c-8781-ba618ecca2fe"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:46.471515 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-99537948-7b6c-421b-9f99-e2a651ecc150 req-c805f14f-9d92-4ab9-a9fc-de55adde374c service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:46.472214 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-99537948-7b6c-421b-9f99-e2a651ecc150 req-c805f14f-9d92-4ab9-a9fc-de55adde374c service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:46.488192 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-99537948-7b6c-421b-9f99-e2a651ecc150 req-c805f14f-9d92-4ab9-a9fc-de55adde374c service nova] Creating event network-vif-deleted:6643f089-18b4-4d4c-8781-ba618ecca2fe for instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d on hv-cinder-80135 Jun 03 13:28:46.494681 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-99537948-7b6c-421b-9f99-e2a651ecc150 req-c805f14f-9d92-4ab9-a9fc-de55adde374c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050359 Jun 03 13:28:46.496086 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 417/775] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:47.050415 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9cabc52d-3305-4f80-b674-50452833a08c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:47.056432 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-9cabc52d-3305-4f80-b674-50452833a08c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:47.058531 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9cabc52d-3305-4f80-b674-50452833a08c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:47.058957 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9cabc52d-3305-4f80-b674-50452833a08c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:47.059720 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9cabc52d-3305-4f80-b674-50452833a08c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:47.060169 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9cabc52d-3305-4f80-b674-50452833a08c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:47.090533 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9cabc52d-3305-4f80-b674-50452833a08c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:47.090972 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9cabc52d-3305-4f80-b674-50452833a08c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:47.091413 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-9cabc52d-3305-4f80-b674-50452833a08c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lazy-loading 'fault' on Instance uuid cfaaead1-3faf-4b34-a756-3d1cc7e7d19d {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:47.132424 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9cabc52d-3305-4f80-b674-50452833a08c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0490962ec743048ef924340c93de20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03432cb8c28c46fba16dc9f88d648d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:47.140630 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9cabc52d-3305-4f80-b674-50452833a08c tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 200 len: 1348 microversion: 2.1 time: 0.093810 Jun 03 13:28:47.147513 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 359/776] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:47 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:48.164172 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-58082eb6-0800-4afa-8350-bee28afd36cc tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:48.164934 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-58082eb6-0800-4afa-8350-bee28afd36cc tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] [instance: cfaaead1-3faf-4b34-a756-3d1cc7e7d19d] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:48.171264 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-58082eb6-0800-4afa-8350-bee28afd36cc tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:48.171711 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-58082eb6-0800-4afa-8350-bee28afd36cc tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:48.172493 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-58082eb6-0800-4afa-8350-bee28afd36cc tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:48.172928 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-58082eb6-0800-4afa-8350-bee28afd36cc tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:48.186522 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-58082eb6-0800-4afa-8350-bee28afd36cc tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] HTTP exception thrown: Instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d could not be found. Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-58082eb6-0800-4afa-8350-bee28afd36cc tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Request method failure captured: Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d HTTP/1.1 Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgt98PWoWOIxwfgGMyJEY2IiKR_Kr6kjIQ4GBC88e1zaZ_XxYP4rFPXgoIKZhw0U5XbgKDs8Q5E9pJTI4eqIM3pFgMdli_EfHkiKnsY3YHbpP-DXXG7IRmJ_Dklbp-VDIG8OFN40QBQcqToMOJOGKuUUcc_2LCewb3sbCOnqhA5kN4A Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 03432cb8c28c46fba16dc9f88d648d11 Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-TestMinimumBasicScenario-826218523 Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:28:48.188067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:28:48.189621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/03432cb8c28c46fba16dc9f88d648d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/03432cb8c28c46fba16dc9f88d648d11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_03432cb8c28c46fba16dc9f88d648d11", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/03432cb8c28c46fba16dc9f88d648d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:28:48.189621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-TestMinimumBasicScenario-826218523 Jun 03 13:28:48.189621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 03432cb8c28c46fba16dc9f88d648d11 Jun 03 13:28:48.189621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-TestMinimumBasicScenario-826218523 Jun 03 13:28:48.189621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-TestMinimumBasicScenario-826218523-project Jun 03 13:28:48.189621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:28:48.189621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:28:48.189621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 4d0490962ec743048ef924340c93de20 Jun 03 13:28:48.189621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-TestMinimumBasicScenario-826218523-project Jun 03 13:28:48.189621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:28:48.189621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d could not be found. Jun 03 13:28:48.189621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': 'cfaaead1-3faf-4b34-a756-3d1cc7e7d19d'} Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d could not be found. Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:28:48.190395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d could not be found. Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d could not be found. Jun 03 13:28:48.191535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:28:48.192636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-58082eb6-0800-4afa-8350-bee28afd36cc tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Returning 404 to user: Instance cfaaead1-3faf-4b34-a756-3d1cc7e7d19d could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:28:48.192636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-58082eb6-0800-4afa-8350-bee28afd36cc tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d" status: 404 len: 111 microversion: 2.1 time: 0.030239 Jun 03 13:28:48.192636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 418/777] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:48 2022] GET /compute/v2.1/servers/cfaaead1-3faf-4b34-a756-3d1cc7e7d19d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:28:48.198499 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-09e7873c-ff40-4a3b-9654-e4e3ab974d84 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] Calling method '.version_select at 0x7f5bc808cca0>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:48.259616 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-09e7873c-ff40-4a3b-9654-e4e3ab974d84 tempest-TestMinimumBasicScenario-826218523 tempest-TestMinimumBasicScenario-826218523-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-225891743" status: 202 len: 0 microversion: 2.1 time: 0.065353 Jun 03 13:28:48.260797 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 360/778] 10.222.0.61 () {58 vars in 1268 bytes} [Fri Jun 3 13:28:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-225891743 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:28:49.080976 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-912e227b-07dd-4825-af6e-403c47af6a48 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:49.082228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-912e227b-07dd-4825-af6e-403c47af6a48 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:49.085469 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:49.089526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-912e227b-07dd-4825-af6e-403c47af6a48 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:49.089966 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-912e227b-07dd-4825-af6e-403c47af6a48 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:49.091259 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-912e227b-07dd-4825-af6e-403c47af6a48 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:49.091852 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-912e227b-07dd-4825-af6e-403c47af6a48 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:49.123357 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-912e227b-07dd-4825-af6e-403c47af6a48 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046373 Jun 03 13:28:49.124342 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 419/779] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:28:49 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:28:49.183566 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-913f3cad-8f1c-4d68-b280-2e4c95b40e28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:49.184090 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-913f3cad-8f1c-4d68-b280-2e4c95b40e28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:49.190641 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-913f3cad-8f1c-4d68-b280-2e4c95b40e28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:49.191272 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-913f3cad-8f1c-4d68-b280-2e4c95b40e28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:49.192015 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-913f3cad-8f1c-4d68-b280-2e4c95b40e28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:49.192467 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-913f3cad-8f1c-4d68-b280-2e4c95b40e28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:49.213816 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:49.220755 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-913f3cad-8f1c-4d68-b280-2e4c95b40e28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Going to try to terminate instance {{(pid=118178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:28:49.703487 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-913f3cad-8f1c-4d68-b280-2e4c95b40e28 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 204 len: 0 microversion: 2.1 time: 0.524303 Jun 03 13:28:49.705464 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 361/780] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:28:49 2022] DELETE /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:28:49.722243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9bb3fdcd-6919-411f-8bed-5bbdfcbb2089 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:49.722989 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9bb3fdcd-6919-411f-8bed-5bbdfcbb2089 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:49.730147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9bb3fdcd-6919-411f-8bed-5bbdfcbb2089 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:49.730592 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9bb3fdcd-6919-411f-8bed-5bbdfcbb2089 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:49.731587 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9bb3fdcd-6919-411f-8bed-5bbdfcbb2089 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:49.732077 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9bb3fdcd-6919-411f-8bed-5bbdfcbb2089 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:49.871880 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9bb3fdcd-6919-411f-8bed-5bbdfcbb2089 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:49.879797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9bb3fdcd-6919-411f-8bed-5bbdfcbb2089 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1673 microversion: 2.1 time: 0.161982 Jun 03 13:28:49.880392 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 420/781] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:49 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:28:50.899575 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-2011d16f-88ce-410c-a36d-fa5038a9a073 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:50.903209 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-2011d16f-88ce-410c-a36d-fa5038a9a073 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:50.910489 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2011d16f-88ce-410c-a36d-fa5038a9a073 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:50.911234 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2011d16f-88ce-410c-a36d-fa5038a9a073 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:50.912028 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2011d16f-88ce-410c-a36d-fa5038a9a073 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:50.912500 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2011d16f-88ce-410c-a36d-fa5038a9a073 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:51.412283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-2011d16f-88ce-410c-a36d-fa5038a9a073 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:51.419882 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-2011d16f-88ce-410c-a36d-fa5038a9a073 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1673 microversion: 2.1 time: 0.524647 Jun 03 13:28:51.421161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 362/782] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:50 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1673 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:52.408944 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-54c8098b-de0a-4fce-b16b-f5f921fdfe00 req-17f9b457-48aa-4f39-a47d-8884d495616f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a334af7a-c5bb-4c6e-aa37-bb7c86b838c2", "name": "network-vif-deleted", "tag": "77ec7712-763e-4c88-ad78-1277b03066fd"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:52.420908 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-54c8098b-de0a-4fce-b16b-f5f921fdfe00 req-17f9b457-48aa-4f39-a47d-8884d495616f service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:52.421811 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-54c8098b-de0a-4fce-b16b-f5f921fdfe00 req-17f9b457-48aa-4f39-a47d-8884d495616f service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:52.438808 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-fdd47f65-8206-4082-a8e3-0fb008d4437a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:52.440132 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-fdd47f65-8206-4082-a8e3-0fb008d4437a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:52.454175 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fdd47f65-8206-4082-a8e3-0fb008d4437a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:52.455045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fdd47f65-8206-4082-a8e3-0fb008d4437a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:52.456348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-54c8098b-de0a-4fce-b16b-f5f921fdfe00 req-17f9b457-48aa-4f39-a47d-8884d495616f service nova] Creating event network-vif-deleted:77ec7712-763e-4c88-ad78-1277b03066fd for instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 on hv-cinder-80135 Jun 03 13:28:52.457250 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fdd47f65-8206-4082-a8e3-0fb008d4437a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:52.458967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fdd47f65-8206-4082-a8e3-0fb008d4437a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:52.468000 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-54c8098b-de0a-4fce-b16b-f5f921fdfe00 req-17f9b457-48aa-4f39-a47d-8884d495616f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063159 Jun 03 13:28:52.469275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 421/783] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:52.556794 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-fdd47f65-8206-4082-a8e3-0fb008d4437a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:52.573030 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-fdd47f65-8206-4082-a8e3-0fb008d4437a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1605 microversion: 2.1 time: 0.131848 Jun 03 13:28:52.573030 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 363/784] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:52 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1605 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:53.586856 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-96dbde69-6eb4-4d07-a4dd-936e7aa93efd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:53.588280 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-96dbde69-6eb4-4d07-a4dd-936e7aa93efd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:53.605752 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-96dbde69-6eb4-4d07-a4dd-936e7aa93efd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:53.610144 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-96dbde69-6eb4-4d07-a4dd-936e7aa93efd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:53.611257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-96dbde69-6eb4-4d07-a4dd-936e7aa93efd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:53.611920 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-96dbde69-6eb4-4d07-a4dd-936e7aa93efd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:53.688009 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-96dbde69-6eb4-4d07-a4dd-936e7aa93efd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:53.688802 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-96dbde69-6eb4-4d07-a4dd-936e7aa93efd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:53.689518 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-96dbde69-6eb4-4d07-a4dd-936e7aa93efd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lazy-loading 'fault' on Instance uuid a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:53.780931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-96dbde69-6eb4-4d07-a4dd-936e7aa93efd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:53.789963 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-96dbde69-6eb4-4d07-a4dd-936e7aa93efd tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 200 len: 1327 microversion: 2.1 time: 0.208273 Jun 03 13:28:53.801473 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 422/785] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:53 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 1327 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:54.807597 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6681e11d-24bc-4892-81f3-3842d8a5022e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:54.808749 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6681e11d-24bc-4892-81f3-3842d8a5022e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:54.811637 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:54.816831 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6681e11d-24bc-4892-81f3-3842d8a5022e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:54.817206 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6681e11d-24bc-4892-81f3-3842d8a5022e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:54.817975 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6681e11d-24bc-4892-81f3-3842d8a5022e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:54.818573 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6681e11d-24bc-4892-81f3-3842d8a5022e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:54.832964 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-6681e11d-24bc-4892-81f3-3842d8a5022e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] HTTP exception thrown: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6681e11d-24bc-4892-81f3-3842d8a5022e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Request method failure captured: Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 HTTP/1.1 Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgrzbZN4t0mx0vq2U1KT3eQTx_rygGF1LofED54D_w51RAZtYADH5goX5HwD9kHOt0wQB8rm8sz88DTlJxz_Nj11klPutZfP3U5-5caYudfSCXi3W6zHiJB7AHmok71AaAiqovZ03U-84OdophGeyXiV8ZLvsV9MeFMLcT4VCiGeKpU Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 5a4dd3e8d45a4dee9be95d8326e00edf Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:28:54.834739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:28:54.836139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5a4dd3e8d45a4dee9be95d8326e00edf", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:28:54.836139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:28:54.836139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 5a4dd3e8d45a4dee9be95d8326e00edf Jun 03 13:28:54.836139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:28:54.836139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-AttachVolumeTestJSON-773152563-project Jun 03 13:28:54.836139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:28:54.836139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:28:54.836139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 7254adba100f4453b2b9a953990dbb41 Jun 03 13:28:54.836139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-AttachVolumeTestJSON-773152563-project Jun 03 13:28:54.836139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:28:54.836139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:28:54.836139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': 'a334af7a-c5bb-4c6e-aa37-bb7c86b838c2'} Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:28:54.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:28:54.838517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:28:54.841334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6681e11d-24bc-4892-81f3-3842d8a5022e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Returning 404 to user: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:28:54.841334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6681e11d-24bc-4892-81f3-3842d8a5022e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 404 len: 111 microversion: 2.1 time: 0.033315 Jun 03 13:28:54.845935 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-311a1eb3-45bd-4fba-8a13-5285cbdb3a20 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '.version_select at 0x7f5bc89c1a60>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:54.849356 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 364/786] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:54 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:28:54.916681 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-311a1eb3-45bd-4fba-8a13-5285cbdb3a20 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-462862448" status: 202 len: 0 microversion: 2.1 time: 0.074473 Jun 03 13:28:54.917283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 423/787] 10.222.0.61 () {58 vars in 1217 bytes} [Fri Jun 3 13:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-462862448 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:28:55.770189 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6937f828-dca4-43bc-83e6-838f4fa57d24 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Action: 'create', calling method: .version_select at 0x7f5bc81485e0>, body: {"keypair": {"name": "tempest-keypair-2125508925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhsnZvZEPsnU9EDH1BdrjxzXKtRrSQZ7ZgZopH7YQXwT1AlajrUqHIZNV/eKvO6dfnW0hZ/+Ms7qeaJDOC68TJubKMjkL6BYLJyajCFJHuUMKGcCB/KqixB7lApRhYo+w=="}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:55.786137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-6937f828-dca4-43bc-83e6-838f4fa57d24 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Getting quotas for project 5a4dd3e8d45a4dee9be95d8326e00edf. Resources: {'key_pairs'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:28:55.790478 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-6937f828-dca4-43bc-83e6-838f4fa57d24 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Getting quotas for user 7254adba100f4453b2b9a953990dbb41 and project 5a4dd3e8d45a4dee9be95d8326e00edf. Resources: {'key_pairs'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:28:55.928645 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6937f828-dca4-43bc-83e6-838f4fa57d24 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162933 Jun 03 13:28:55.929290 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 365/788] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 13:28:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:58.872582 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-968301970", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c0be2bd-39e0-439b-a4bd-28be0360d31a"}], "security_groups": [{"name": "tempest-securitygroup--2007267986"}], "key_name": "tempest-keypair-2125508925", "user_data": "}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:58.981466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] validate_networks() for [('3c0be2bd-39e0-439b-a4bd-28be0360d31a', None, None, None, None, None)] {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:28:59.355978 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:28:59.356450 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:28:59.356929 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:28:59.357426 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:28:59.357955 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:28:59.366767 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:59.367218 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:59.368013 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:59.368627 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:59.386073 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Getting quotas for project 5a4dd3e8d45a4dee9be95d8326e00edf. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:28:59.389980 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Getting quotas for user 7254adba100f4453b2b9a953990dbb41 and project 5a4dd3e8d45a4dee9be95d8326e00edf. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:28:59.400698 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:28:59.403159 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:28:59.523342 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-dd63950f-200c-4cd7-9bac-2e2ca759bdcf tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.655753 Jun 03 13:28:59.523989 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 424/789] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:28:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:28:59.534911 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8bb8bcdd-113a-490d-bc54-2321cfc7c811 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:59.535656 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8bb8bcdd-113a-490d-bc54-2321cfc7c811 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:59.596896 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8bb8bcdd-113a-490d-bc54-2321cfc7c811 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:59.604551 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8bb8bcdd-113a-490d-bc54-2321cfc7c811 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1237 microversion: 2.1 time: 0.074393 Jun 03 13:28:59.605829 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 366/790] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:59 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:00.625357 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c9ea6ade-e4d9-4452-a2d1-02e9b3329fa1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:00.626149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c9ea6ade-e4d9-4452-a2d1-02e9b3329fa1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:00.639630 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9ea6ade-e4d9-4452-a2d1-02e9b3329fa1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:00.640646 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9ea6ade-e4d9-4452-a2d1-02e9b3329fa1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:00.641829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9ea6ade-e4d9-4452-a2d1-02e9b3329fa1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:00.642381 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9ea6ade-e4d9-4452-a2d1-02e9b3329fa1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:00.714171 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c9ea6ade-e4d9-4452-a2d1-02e9b3329fa1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:00.722131 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c9ea6ade-e4d9-4452-a2d1-02e9b3329fa1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1241 microversion: 2.1 time: 0.103426 Jun 03 13:29:00.722921 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 425/791] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:00 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:01.738886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6c0d4f7b-6c27-4692-90a6-aae419a209d0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:01.739498 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6c0d4f7b-6c27-4692-90a6-aae419a209d0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:01.746393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6c0d4f7b-6c27-4692-90a6-aae419a209d0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:01.753879 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6c0d4f7b-6c27-4692-90a6-aae419a209d0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:01.753879 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6c0d4f7b-6c27-4692-90a6-aae419a209d0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:01.753879 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6c0d4f7b-6c27-4692-90a6-aae419a209d0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:01.811085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6c0d4f7b-6c27-4692-90a6-aae419a209d0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:01.818978 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6c0d4f7b-6c27-4692-90a6-aae419a209d0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1289 microversion: 2.1 time: 0.084034 Jun 03 13:29:01.819532 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 367/792] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:01 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:02.838285 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-09cff38f-1ec0-418b-bff3-248ac452c88c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:02.838976 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-09cff38f-1ec0-418b-bff3-248ac452c88c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:02.846424 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-09cff38f-1ec0-418b-bff3-248ac452c88c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:02.847178 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-09cff38f-1ec0-418b-bff3-248ac452c88c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:02.848189 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-09cff38f-1ec0-418b-bff3-248ac452c88c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:02.848839 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-09cff38f-1ec0-418b-bff3-248ac452c88c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:02.915395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-09cff38f-1ec0-418b-bff3-248ac452c88c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:02.923593 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-09cff38f-1ec0-418b-bff3-248ac452c88c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1295 microversion: 2.1 time: 0.090198 Jun 03 13:29:02.924288 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 426/793] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:02 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:03.943314 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-051674ef-7872-4893-bf44-8793bc462d4e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:03.951375 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-051674ef-7872-4893-bf44-8793bc462d4e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:03.951375 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-051674ef-7872-4893-bf44-8793bc462d4e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:03.951375 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-051674ef-7872-4893-bf44-8793bc462d4e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:03.951853 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-051674ef-7872-4893-bf44-8793bc462d4e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:03.952406 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-051674ef-7872-4893-bf44-8793bc462d4e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:04.109865 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-b43a3dfd-c96b-47a2-bea0-9c0090aa19e5 req-c0ab9fbf-abec-4d6a-aa3f-7cf8128ae23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58052462-e468-4d11-b88d-19551ae5f17f", "tag": "32b26cad-6b8d-4a6a-843f-1e7463db5249"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:29:04.118965 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-b43a3dfd-c96b-47a2-bea0-9c0090aa19e5 req-c0ab9fbf-abec-4d6a-aa3f-7cf8128ae23c service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:04.119448 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-b43a3dfd-c96b-47a2-bea0-9c0090aa19e5 req-c0ab9fbf-abec-4d6a-aa3f-7cf8128ae23c service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:04.123614 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:04.131220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-b43a3dfd-c96b-47a2-bea0-9c0090aa19e5 req-c0ab9fbf-abec-4d6a-aa3f-7cf8128ae23c service nova] Creating event network-changed:32b26cad-6b8d-4a6a-843f-1e7463db5249 for instance 58052462-e468-4d11-b88d-19551ae5f17f on hv-cinder-80135 Jun 03 13:29:04.138713 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-b43a3dfd-c96b-47a2-bea0-9c0090aa19e5 req-c0ab9fbf-abec-4d6a-aa3f-7cf8128ae23c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033172 Jun 03 13:29:04.139470 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 427/794] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:29:04.147837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-051674ef-7872-4893-bf44-8793bc462d4e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:04.161099 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-051674ef-7872-4893-bf44-8793bc462d4e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1363 microversion: 2.1 time: 0.221788 Jun 03 13:29:04.166430 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 368/795] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:03 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:05.184334 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-eab0a062-c6ca-49fe-8aa5-dc6b9a13bc00 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:05.185862 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-eab0a062-c6ca-49fe-8aa5-dc6b9a13bc00 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:05.192424 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-eab0a062-c6ca-49fe-8aa5-dc6b9a13bc00 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:05.192881 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-eab0a062-c6ca-49fe-8aa5-dc6b9a13bc00 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:05.193651 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-eab0a062-c6ca-49fe-8aa5-dc6b9a13bc00 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:05.194096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-eab0a062-c6ca-49fe-8aa5-dc6b9a13bc00 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:05.324852 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-eab0a062-c6ca-49fe-8aa5-dc6b9a13bc00 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:05.332287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-eab0a062-c6ca-49fe-8aa5-dc6b9a13bc00 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1363 microversion: 2.1 time: 0.153136 Jun 03 13:29:05.332860 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 428/796] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:05 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:06.349862 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-147c8b1a-6be4-465a-abdb-66e3886f5c31 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:06.350531 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-147c8b1a-6be4-465a-abdb-66e3886f5c31 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:06.357654 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-147c8b1a-6be4-465a-abdb-66e3886f5c31 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:06.358102 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-147c8b1a-6be4-465a-abdb-66e3886f5c31 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:06.358907 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-147c8b1a-6be4-465a-abdb-66e3886f5c31 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:06.359399 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-147c8b1a-6be4-465a-abdb-66e3886f5c31 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:06.488698 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-147c8b1a-6be4-465a-abdb-66e3886f5c31 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:06.496241 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-147c8b1a-6be4-465a-abdb-66e3886f5c31 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1363 microversion: 2.1 time: 0.150469 Jun 03 13:29:06.496824 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 369/797] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:06 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:07.514509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8bf5f897-5ec5-40c7-83af-282c2e947555 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:07.515197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8bf5f897-5ec5-40c7-83af-282c2e947555 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:07.521701 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8bf5f897-5ec5-40c7-83af-282c2e947555 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:07.522151 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8bf5f897-5ec5-40c7-83af-282c2e947555 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:07.522908 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8bf5f897-5ec5-40c7-83af-282c2e947555 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:07.523346 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8bf5f897-5ec5-40c7-83af-282c2e947555 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:07.653968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8bf5f897-5ec5-40c7-83af-282c2e947555 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:07.661288 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8bf5f897-5ec5-40c7-83af-282c2e947555 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1363 microversion: 2.1 time: 0.151363 Jun 03 13:29:07.661840 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 429/798] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:07 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:08.678366 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6b64fcf9-d537-4c5a-9c6f-f715758b1eec tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:08.679017 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6b64fcf9-d537-4c5a-9c6f-f715758b1eec tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:08.685982 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6b64fcf9-d537-4c5a-9c6f-f715758b1eec tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:08.686424 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6b64fcf9-d537-4c5a-9c6f-f715758b1eec tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:08.687185 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6b64fcf9-d537-4c5a-9c6f-f715758b1eec tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:08.687620 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6b64fcf9-d537-4c5a-9c6f-f715758b1eec tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:08.822018 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6b64fcf9-d537-4c5a-9c6f-f715758b1eec tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:08.830072 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6b64fcf9-d537-4c5a-9c6f-f715758b1eec tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1363 microversion: 2.1 time: 0.155639 Jun 03 13:29:08.830634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 370/799] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:08 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:29:09.850088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-43e4fc4d-fd0b-4316-87e3-69007d1d5942 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:09.850088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-43e4fc4d-fd0b-4316-87e3-69007d1d5942 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:09.852123 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:09.854105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=6 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:09.856789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-43e4fc4d-fd0b-4316-87e3-69007d1d5942 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:09.857723 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-43e4fc4d-fd0b-4316-87e3-69007d1d5942 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:09.858582 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-43e4fc4d-fd0b-4316-87e3-69007d1d5942 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:09.859031 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-43e4fc4d-fd0b-4316-87e3-69007d1d5942 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:09.959668 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-bdfcc975-8197-43f8-a1c2-d30f061bd366 req-42b05ee8-e57f-4b61-9d0b-73a5157ed046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58052462-e468-4d11-b88d-19551ae5f17f", "name": "network-vif-plugged", "status": "completed", "tag": "32b26cad-6b8d-4a6a-843f-1e7463db5249"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:29:09.965280 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=6 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:09.970445 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-bdfcc975-8197-43f8-a1c2-d30f061bd366 req-42b05ee8-e57f-4b61-9d0b-73a5157ed046 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:09.971047 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-bdfcc975-8197-43f8-a1c2-d30f061bd366 req-42b05ee8-e57f-4b61-9d0b-73a5157ed046 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:09.982985 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-bdfcc975-8197-43f8-a1c2-d30f061bd366 req-42b05ee8-e57f-4b61-9d0b-73a5157ed046 service nova] Creating event network-vif-plugged:32b26cad-6b8d-4a6a-843f-1e7463db5249 for instance 58052462-e468-4d11-b88d-19551ae5f17f on hv-cinder-80135 Jun 03 13:29:09.988253 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-bdfcc975-8197-43f8-a1c2-d30f061bd366 req-42b05ee8-e57f-4b61-9d0b-73a5157ed046 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032066 Jun 03 13:29:09.988837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 371/800] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:29:10.007652 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-43e4fc4d-fd0b-4316-87e3-69007d1d5942 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:10.012738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-43e4fc4d-fd0b-4316-87e3-69007d1d5942 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1363 microversion: 2.1 time: 0.169848 Jun 03 13:29:10.013839 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 430/801] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:09 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:11.032021 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0f692bc9-26e7-454a-82cc-23d08137f94d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:11.032925 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0f692bc9-26e7-454a-82cc-23d08137f94d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:11.039749 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0f692bc9-26e7-454a-82cc-23d08137f94d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:11.040225 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0f692bc9-26e7-454a-82cc-23d08137f94d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:11.040987 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0f692bc9-26e7-454a-82cc-23d08137f94d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:11.041421 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0f692bc9-26e7-454a-82cc-23d08137f94d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:11.177362 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0f692bc9-26e7-454a-82cc-23d08137f94d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:11.193738 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0f692bc9-26e7-454a-82cc-23d08137f94d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1363 microversion: 2.1 time: 0.167241 Jun 03 13:29:11.196895 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 372/802] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:11 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:12.210578 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0066f775-908f-4b22-91f4-9f3290a7c327 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:12.211188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0066f775-908f-4b22-91f4-9f3290a7c327 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:12.220121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0066f775-908f-4b22-91f4-9f3290a7c327 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:12.220595 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0066f775-908f-4b22-91f4-9f3290a7c327 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:12.221408 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0066f775-908f-4b22-91f4-9f3290a7c327 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:12.221842 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0066f775-908f-4b22-91f4-9f3290a7c327 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:12.370527 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0066f775-908f-4b22-91f4-9f3290a7c327 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:12.378639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0066f775-908f-4b22-91f4-9f3290a7c327 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1363 microversion: 2.1 time: 0.171848 Jun 03 13:29:12.379146 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 431/803] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:12 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:13.394921 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-da847fee-c893-4e4b-a3b8-1ee2209b18d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:13.395588 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-da847fee-c893-4e4b-a3b8-1ee2209b18d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:13.402310 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-da847fee-c893-4e4b-a3b8-1ee2209b18d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:13.402781 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-da847fee-c893-4e4b-a3b8-1ee2209b18d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:13.403587 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-da847fee-c893-4e4b-a3b8-1ee2209b18d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:13.404361 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-da847fee-c893-4e4b-a3b8-1ee2209b18d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:13.538640 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-da847fee-c893-4e4b-a3b8-1ee2209b18d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:13.546665 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-da847fee-c893-4e4b-a3b8-1ee2209b18d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1549 microversion: 2.1 time: 0.155603 Jun 03 13:29:13.547311 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 373/804] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:13 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:13.563845 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b22d0c68-463b-4598-a5cc-5162d35b9c65 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:13.564423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b22d0c68-463b-4598-a5cc-5162d35b9c65 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:13.570849 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b22d0c68-463b-4598-a5cc-5162d35b9c65 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:13.571305 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b22d0c68-463b-4598-a5cc-5162d35b9c65 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:13.572091 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b22d0c68-463b-4598-a5cc-5162d35b9c65 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:13.572566 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b22d0c68-463b-4598-a5cc-5162d35b9c65 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:13.649655 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b22d0c68-463b-4598-a5cc-5162d35b9c65 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090638 Jun 03 13:29:13.650263 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 432/805] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 13:29:13 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:29:14.630569 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-41c47c00-7da5-435f-b65a-2c60cf3fed25 req-61be8678-70d5-4318-9f16-95a02a0064a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58052462-e468-4d11-b88d-19551ae5f17f", "tag": "32b26cad-6b8d-4a6a-843f-1e7463db5249"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:29:14.639887 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-41c47c00-7da5-435f-b65a-2c60cf3fed25 req-61be8678-70d5-4318-9f16-95a02a0064a2 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:14.640357 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-41c47c00-7da5-435f-b65a-2c60cf3fed25 req-61be8678-70d5-4318-9f16-95a02a0064a2 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:14.654865 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-41c47c00-7da5-435f-b65a-2c60cf3fed25 req-61be8678-70d5-4318-9f16-95a02a0064a2 service nova] Creating event network-changed:32b26cad-6b8d-4a6a-843f-1e7463db5249 for instance 58052462-e468-4d11-b88d-19551ae5f17f on hv-cinder-80135 Jun 03 13:29:14.660535 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-41c47c00-7da5-435f-b65a-2c60cf3fed25 req-61be8678-70d5-4318-9f16-95a02a0064a2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033492 Jun 03 13:29:14.661358 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 374/806] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:29:41.594816 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:41.595811 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=28 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:41.599694 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b76491e1-79f2-4cf5-8806-614fbc2d2b5b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:41.600218 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b76491e1-79f2-4cf5-8806-614fbc2d2b5b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:41.606156 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b76491e1-79f2-4cf5-8806-614fbc2d2b5b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:41.606618 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b76491e1-79f2-4cf5-8806-614fbc2d2b5b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:41.607379 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b76491e1-79f2-4cf5-8806-614fbc2d2b5b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:41.607819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b76491e1-79f2-4cf5-8806-614fbc2d2b5b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:41.635100 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b76491e1-79f2-4cf5-8806-614fbc2d2b5b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Going to try to terminate instance {{(pid=118179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:29:41.903466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b76491e1-79f2-4cf5-8806-614fbc2d2b5b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 204 len: 0 microversion: 2.1 time: 0.309918 Jun 03 13:29:41.903962 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 433/807] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:29:41 2022] DELETE /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:29:41.913086 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b8eb1075-f790-48ce-85c4-26ead83af915 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:41.913792 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b8eb1075-f790-48ce-85c4-26ead83af915 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:41.915926 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:41.916617 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:41.921551 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b8eb1075-f790-48ce-85c4-26ead83af915 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:41.922008 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b8eb1075-f790-48ce-85c4-26ead83af915 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:41.922784 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b8eb1075-f790-48ce-85c4-26ead83af915 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:41.923842 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b8eb1075-f790-48ce-85c4-26ead83af915 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:42.057768 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b8eb1075-f790-48ce-85c4-26ead83af915 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:42.065505 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b8eb1075-f790-48ce-85c4-26ead83af915 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1576 microversion: 2.1 time: 0.156982 Jun 03 13:29:42.066068 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 375/808] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:41 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:43.083252 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-04ef8f56-61bf-4c5e-930d-7789aae9cc1c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:43.083957 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-04ef8f56-61bf-4c5e-930d-7789aae9cc1c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:43.090454 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-04ef8f56-61bf-4c5e-930d-7789aae9cc1c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:43.090911 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-04ef8f56-61bf-4c5e-930d-7789aae9cc1c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:43.091675 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-04ef8f56-61bf-4c5e-930d-7789aae9cc1c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:43.092115 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-04ef8f56-61bf-4c5e-930d-7789aae9cc1c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:43.221452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-04ef8f56-61bf-4c5e-930d-7789aae9cc1c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:43.229030 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-04ef8f56-61bf-4c5e-930d-7789aae9cc1c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1576 microversion: 2.1 time: 0.150662 Jun 03 13:29:43.229599 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 434/809] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:43 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:44.247086 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e6372fb1-5079-4d90-b234-930e2e47cd20 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:44.252124 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e6372fb1-5079-4d90-b234-930e2e47cd20 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:44.255496 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e6372fb1-5079-4d90-b234-930e2e47cd20 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:44.255943 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e6372fb1-5079-4d90-b234-930e2e47cd20 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:44.256734 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e6372fb1-5079-4d90-b234-930e2e47cd20 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:44.257254 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e6372fb1-5079-4d90-b234-930e2e47cd20 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:44.438167 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e6372fb1-5079-4d90-b234-930e2e47cd20 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:44.446259 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e6372fb1-5079-4d90-b234-930e2e47cd20 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1576 microversion: 2.1 time: 0.203282 Jun 03 13:29:44.446814 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 376/810] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:44 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:44.766542 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-ecfef72f-336f-41e1-96d7-c646f4b629cf req-432f3bd9-26d6-43ea-9869-2438057e2310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948a342e-2849-416a-a15b-86ca72bb08d7", "name": "network-vif-deleted", "tag": "36459da4-523e-4b02-9ab9-8cf2c08ac474"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:29:44.775562 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-ecfef72f-336f-41e1-96d7-c646f4b629cf req-432f3bd9-26d6-43ea-9869-2438057e2310 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:44.776346 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-ecfef72f-336f-41e1-96d7-c646f4b629cf req-432f3bd9-26d6-43ea-9869-2438057e2310 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:44.788542 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-ecfef72f-336f-41e1-96d7-c646f4b629cf req-432f3bd9-26d6-43ea-9869-2438057e2310 service nova] Creating event network-vif-deleted:36459da4-523e-4b02-9ab9-8cf2c08ac474 for instance 948a342e-2849-416a-a15b-86ca72bb08d7 on hv-cinder-80135 Jun 03 13:29:44.794709 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-ecfef72f-336f-41e1-96d7-c646f4b629cf req-432f3bd9-26d6-43ea-9869-2438057e2310 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031914 Jun 03 13:29:44.795432 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 435/811] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:29:45.464551 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-605cbe99-8b0c-43f3-a7ea-59d9bb33447e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:45.465161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-605cbe99-8b0c-43f3-a7ea-59d9bb33447e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:45.471960 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-605cbe99-8b0c-43f3-a7ea-59d9bb33447e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:45.472444 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-605cbe99-8b0c-43f3-a7ea-59d9bb33447e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:45.473235 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-605cbe99-8b0c-43f3-a7ea-59d9bb33447e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:45.473676 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-605cbe99-8b0c-43f3-a7ea-59d9bb33447e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:45.541542 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-605cbe99-8b0c-43f3-a7ea-59d9bb33447e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:45.550426 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-605cbe99-8b0c-43f3-a7ea-59d9bb33447e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1509 microversion: 2.1 time: 0.090125 Jun 03 13:29:45.551019 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 377/812] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:45 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1509 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:46.568624 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-318ff126-833f-476a-80b1-8cac74d87a7e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:46.569337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-318ff126-833f-476a-80b1-8cac74d87a7e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:46.576015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-318ff126-833f-476a-80b1-8cac74d87a7e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:46.576498 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-318ff126-833f-476a-80b1-8cac74d87a7e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:46.577263 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-318ff126-833f-476a-80b1-8cac74d87a7e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:46.577706 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-318ff126-833f-476a-80b1-8cac74d87a7e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:46.643481 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-318ff126-833f-476a-80b1-8cac74d87a7e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:46.651619 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-318ff126-833f-476a-80b1-8cac74d87a7e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1509 microversion: 2.1 time: 0.087900 Jun 03 13:29:46.652216 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 436/813] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:46 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1509 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:47.048557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-46e7467e-c87f-4342-9947-c834d290b056 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:47.049302 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-46e7467e-c87f-4342-9947-c834d290b056 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:47.055852 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46e7467e-c87f-4342-9947-c834d290b056 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:47.056352 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46e7467e-c87f-4342-9947-c834d290b056 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:47.057125 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46e7467e-c87f-4342-9947-c834d290b056 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:47.057639 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46e7467e-c87f-4342-9947-c834d290b056 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:47.082545 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-46e7467e-c87f-4342-9947-c834d290b056 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/ips" status: 200 len: 152 microversion: 2.20 time: 0.038743 Jun 03 13:29:47.083106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 378/814] 10.222.0.61 () {60 vars in 1288 bytes} [Fri Jun 3 13:29:47 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:29:47.669486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e557d967-985f-44d2-a905-aaabbf3b8015 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:47.670212 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e557d967-985f-44d2-a905-aaabbf3b8015 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:47.677512 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e557d967-985f-44d2-a905-aaabbf3b8015 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:47.680272 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e557d967-985f-44d2-a905-aaabbf3b8015 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:47.680272 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e557d967-985f-44d2-a905-aaabbf3b8015 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:47.680272 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e557d967-985f-44d2-a905-aaabbf3b8015 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:47.740451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e557d967-985f-44d2-a905-aaabbf3b8015 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:47.747916 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e557d967-985f-44d2-a905-aaabbf3b8015 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1225 microversion: 2.1 time: 0.082402 Jun 03 13:29:47.748509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 437/815] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:47 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:48.765808 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d0d69ca1-c322-4348-a768-947711490c98 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:48.766458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d0d69ca1-c322-4348-a768-947711490c98 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:48.773357 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d0d69ca1-c322-4348-a768-947711490c98 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:48.773807 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d0d69ca1-c322-4348-a768-947711490c98 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:48.774570 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d0d69ca1-c322-4348-a768-947711490c98 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:48.775010 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d0d69ca1-c322-4348-a768-947711490c98 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:48.838874 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d0d69ca1-c322-4348-a768-947711490c98 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:48.847016 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d0d69ca1-c322-4348-a768-947711490c98 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1225 microversion: 2.1 time: 0.084554 Jun 03 13:29:48.847910 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 379/816] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:48 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:49.863529 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-639b173d-6d88-4429-89ce-2f2414e8393f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:49.864175 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-639b173d-6d88-4429-89ce-2f2414e8393f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:49.870795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-639b173d-6d88-4429-89ce-2f2414e8393f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:49.871187 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-639b173d-6d88-4429-89ce-2f2414e8393f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:49.871963 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-639b173d-6d88-4429-89ce-2f2414e8393f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:49.872433 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-639b173d-6d88-4429-89ce-2f2414e8393f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:49.905494 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-639b173d-6d88-4429-89ce-2f2414e8393f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:49.905953 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-639b173d-6d88-4429-89ce-2f2414e8393f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:49.906404 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-639b173d-6d88-4429-89ce-2f2414e8393f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lazy-loading 'fault' on Instance uuid 948a342e-2849-416a-a15b-86ca72bb08d7 {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:29:49.949912 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-639b173d-6d88-4429-89ce-2f2414e8393f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:49.957771 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-639b173d-6d88-4429-89ce-2f2414e8393f tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 200 len: 1230 microversion: 2.1 time: 0.098290 Jun 03 13:29:49.958396 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 438/817] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:49 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:50.330894 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f4d9c1ff-c5f2-403b-a5b2-3a7642c9c058 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:29:50.331479 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f4d9c1ff-c5f2-403b-a5b2-3a7642c9c058 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:50.337781 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f4d9c1ff-c5f2-403b-a5b2-3a7642c9c058 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:50.338230 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f4d9c1ff-c5f2-403b-a5b2-3a7642c9c058 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:50.339017 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f4d9c1ff-c5f2-403b-a5b2-3a7642c9c058 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:50.339452 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f4d9c1ff-c5f2-403b-a5b2-3a7642c9c058 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:50.362608 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-f4d9c1ff-c5f2-403b-a5b2-3a7642c9c058 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lazy-loading 'flavor' on Instance uuid 9f51fd4a-3353-43f3-b528-c767e6b916d8 {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:29:50.816918 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f4d9c1ff-c5f2-403b-a5b2-3a7642c9c058 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "POST /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/action" status: 202 len: 0 microversion: 2.20 time: 0.490358 Jun 03 13:29:50.817571 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 380/818] 10.222.0.61 () {62 vars in 1318 bytes} [Fri Jun 3 13:29:50 2022] POST /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:29:50.828826 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9c09b995-cc68-418a-844c-e0e2dd933887 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:50.829446 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9c09b995-cc68-418a-844c-e0e2dd933887 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:50.836294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9c09b995-cc68-418a-844c-e0e2dd933887 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:50.836750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9c09b995-cc68-418a-844c-e0e2dd933887 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:50.837524 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9c09b995-cc68-418a-844c-e0e2dd933887 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:50.838125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9c09b995-cc68-418a-844c-e0e2dd933887 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:50.969568 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9c09b995-cc68-418a-844c-e0e2dd933887 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:50.978174 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9c09b995-cc68-418a-844c-e0e2dd933887 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:50.979690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9c09b995-cc68-418a-844c-e0e2dd933887 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:50.980883 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9c09b995-cc68-418a-844c-e0e2dd933887 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.157293 Jun 03 13:29:50.981357 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-40fe9dd5-f2cf-4bf8-9209-0a9df98e1e05 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:50.981512 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 439/819] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:29:50 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:29:50.982265 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-40fe9dd5-f2cf-4bf8-9209-0a9df98e1e05 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:50.989115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-40fe9dd5-f2cf-4bf8-9209-0a9df98e1e05 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:50.989567 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-40fe9dd5-f2cf-4bf8-9209-0a9df98e1e05 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:50.990430 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-40fe9dd5-f2cf-4bf8-9209-0a9df98e1e05 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:50.990835 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-40fe9dd5-f2cf-4bf8-9209-0a9df98e1e05 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:51.006279 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-40fe9dd5-f2cf-4bf8-9209-0a9df98e1e05 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] HTTP exception thrown: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-40fe9dd5-f2cf-4bf8-9209-0a9df98e1e05 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Request method failure captured: Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 HTTP/1.1 Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgvyYA2IiU9TNANuA9VpS1K_dH6gWP_NNBA4PxyBqTO0jYJi3mQjFRQw1U2PEQnukK8FJQArs-iifZ6mwbFMyNOquvoO-6Q_Epk1eRiAorgp5JhpfBzUB2r-IkuxbuqGK9tFhoyYeA9iGqNg-sL6xhKxb1_vWNRyU0IzM0MLauoiOjE Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: c880a17cc9844081bee38006d5b92f86 Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-TestVolumeBootPattern-124618305 Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:29:51.007936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:29:51.009686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c880a17cc9844081bee38006d5b92f86", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:29:51.009686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-TestVolumeBootPattern-124618305 Jun 03 13:29:51.009686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: c880a17cc9844081bee38006d5b92f86 Jun 03 13:29:51.009686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-TestVolumeBootPattern-124618305 Jun 03 13:29:51.009686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-TestVolumeBootPattern-124618305-project Jun 03 13:29:51.009686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:29:51.009686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:29:51.009686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 77c56945d1d74a1eaa5e0c8f9e43f086 Jun 03 13:29:51.009686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-TestVolumeBootPattern-124618305-project Jun 03 13:29:51.009686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:29:51.009686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:29:51.009686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '948a342e-2849-416a-a15b-86ca72bb08d7'} Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:29:51.010703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:29:51.012199 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:29:51.013536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-40fe9dd5-f2cf-4bf8-9209-0a9df98e1e05 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Returning 404 to user: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:29:51.013536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-40fe9dd5-f2cf-4bf8-9209-0a9df98e1e05 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 404 len: 111 microversion: 2.1 time: 0.032407 Jun 03 13:29:51.013536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 381/820] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:50 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:29:51.106332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-332107721", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-453693398", "security_groups": [{"name": "tempest-secgroup-smoke-921469941"}], "block_device_mapping_v2": [{"uuid": "b38d166f-7a63-4aa5-9158-806eedcfc538", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2487575-f377-4558-bc42-3d6e3c396511"}]}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:29:51.218362 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] validate_networks() for [('f2487575-f377-4558-bc42-3d6e3c396511', None, None, None, None, None)] {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:29:51.592898 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:29:51.593311 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:29:51.593778 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:29:51.594179 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:29:51.594584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:29:51.603906 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:51.604395 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:51.605187 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:51.605618 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:51.621868 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Getting quotas for project c880a17cc9844081bee38006d5b92f86. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:29:51.625960 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Getting quotas for user 77c56945d1d74a1eaa5e0c8f9e43f086 and project c880a17cc9844081bee38006d5b92f86. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:29:51.683125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:29:51.685323 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b38d166f-7a63-4aa5-9158-806eedcfc538',volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:29:52.000062 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d1f22f7f-1452-446f-aa89-c6a9533a4fde tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:52.000956 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d1f22f7f-1452-446f-aa89-c6a9533a4fde tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:52.007748 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d1f22f7f-1452-446f-aa89-c6a9533a4fde tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:52.008254 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d1f22f7f-1452-446f-aa89-c6a9533a4fde tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:52.009022 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d1f22f7f-1452-446f-aa89-c6a9533a4fde tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:52.009449 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d1f22f7f-1452-446f-aa89-c6a9533a4fde tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:52.134145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5390428c-0601-4d7f-ac7a-02f997258728 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.031618 Jun 03 13:29:52.139709 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 440/821] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:29:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:29:52.144091 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d1f22f7f-1452-446f-aa89-c6a9533a4fde tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:52.150760 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-eee04c5a-ccd6-4038-a0b5-83ee88e9b3a9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:52.151472 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-eee04c5a-ccd6-4038-a0b5-83ee88e9b3a9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:52.165284 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d1f22f7f-1452-446f-aa89-c6a9533a4fde tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:52.166795 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d1f22f7f-1452-446f-aa89-c6a9533a4fde tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:52.167974 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d1f22f7f-1452-446f-aa89-c6a9533a4fde tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.172214 Jun 03 13:29:52.168716 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 382/822] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:29:51 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:29:52.211995 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-eee04c5a-ccd6-4038-a0b5-83ee88e9b3a9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:52.219734 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-eee04c5a-ccd6-4038-a0b5-83ee88e9b3a9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1093 microversion: 2.1 time: 0.072976 Jun 03 13:29:52.220400 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 441/823] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:52 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:53.186464 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-2749caa2-5190-4a88-b36e-40ce30f6b780 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:53.187081 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-2749caa2-5190-4a88-b36e-40ce30f6b780 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:53.194648 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2749caa2-5190-4a88-b36e-40ce30f6b780 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:53.195108 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2749caa2-5190-4a88-b36e-40ce30f6b780 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:53.195881 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2749caa2-5190-4a88-b36e-40ce30f6b780 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:53.196356 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2749caa2-5190-4a88-b36e-40ce30f6b780 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:53.243053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-118b9704-05a2-4048-9642-e96956679062 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:53.243890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-118b9704-05a2-4048-9642-e96956679062 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:53.251343 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-118b9704-05a2-4048-9642-e96956679062 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:53.252072 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-118b9704-05a2-4048-9642-e96956679062 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:53.253443 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-118b9704-05a2-4048-9642-e96956679062 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:53.253876 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-118b9704-05a2-4048-9642-e96956679062 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:53.334860 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-118b9704-05a2-4048-9642-e96956679062 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:53.342753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-118b9704-05a2-4048-9642-e96956679062 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1143 microversion: 2.1 time: 0.103392 Jun 03 13:29:53.343507 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 442/824] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:53 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1143 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:29:53.361001 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-2749caa2-5190-4a88-b36e-40ce30f6b780 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:53.369654 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-2749caa2-5190-4a88-b36e-40ce30f6b780 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:53.371255 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-2749caa2-5190-4a88-b36e-40ce30f6b780 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:53.372447 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-2749caa2-5190-4a88-b36e-40ce30f6b780 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.189924 Jun 03 13:29:53.373172 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 383/825] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:29:53 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:29:54.361672 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9624d5c5-fedb-415d-b005-6492c856d105 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:54.363728 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9624d5c5-fedb-415d-b005-6492c856d105 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:54.370619 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9624d5c5-fedb-415d-b005-6492c856d105 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:54.371156 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9624d5c5-fedb-415d-b005-6492c856d105 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:54.372003 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9624d5c5-fedb-415d-b005-6492c856d105 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:54.372474 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9624d5c5-fedb-415d-b005-6492c856d105 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:54.391253 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a1a1f902-5e33-4cd0-bae7-433409c3d814 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:54.395745 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a1a1f902-5e33-4cd0-bae7-433409c3d814 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:54.399248 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a1a1f902-5e33-4cd0-bae7-433409c3d814 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:54.399706 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a1a1f902-5e33-4cd0-bae7-433409c3d814 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:54.400691 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a1a1f902-5e33-4cd0-bae7-433409c3d814 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:54.401311 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a1a1f902-5e33-4cd0-bae7-433409c3d814 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:54.451980 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9624d5c5-fedb-415d-b005-6492c856d105 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:54.462104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9624d5c5-fedb-415d-b005-6492c856d105 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1199 microversion: 2.1 time: 0.104742 Jun 03 13:29:54.470311 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 443/826] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:54 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1199 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:54.707983 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a1a1f902-5e33-4cd0-bae7-433409c3d814 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:54.716604 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a1a1f902-5e33-4cd0-bae7-433409c3d814 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:54.718123 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a1a1f902-5e33-4cd0-bae7-433409c3d814 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:54.719295 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a1a1f902-5e33-4cd0-bae7-433409c3d814 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.332325 Jun 03 13:29:54.719850 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 384/827] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:29:54 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:29:55.491276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a96a7280-2f65-4ea2-9fea-46999a45a2b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:55.492521 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a96a7280-2f65-4ea2-9fea-46999a45a2b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:55.499404 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a96a7280-2f65-4ea2-9fea-46999a45a2b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:55.504449 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a96a7280-2f65-4ea2-9fea-46999a45a2b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:55.504449 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a96a7280-2f65-4ea2-9fea-46999a45a2b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:55.504449 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a96a7280-2f65-4ea2-9fea-46999a45a2b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:55.711504 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a96a7280-2f65-4ea2-9fea-46999a45a2b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:55.719634 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a96a7280-2f65-4ea2-9fea-46999a45a2b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1276 microversion: 2.1 time: 0.232602 Jun 03 13:29:55.720787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 444/828] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:55 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:55.738987 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8ee41b9e-4724-41c4-951c-1390045f2e9c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:55.744683 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8ee41b9e-4724-41c4-951c-1390045f2e9c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:55.749109 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8ee41b9e-4724-41c4-951c-1390045f2e9c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:55.749772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8ee41b9e-4724-41c4-951c-1390045f2e9c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:55.750994 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8ee41b9e-4724-41c4-951c-1390045f2e9c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:55.751488 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8ee41b9e-4724-41c4-951c-1390045f2e9c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:56.022582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8ee41b9e-4724-41c4-951c-1390045f2e9c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:56.030967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8ee41b9e-4724-41c4-951c-1390045f2e9c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:56.032585 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8ee41b9e-4724-41c4-951c-1390045f2e9c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:56.035741 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8ee41b9e-4724-41c4-951c-1390045f2e9c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.299973 Jun 03 13:29:56.035741 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 385/829] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:29:55 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:29:56.618879 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-e1d832cc-339b-4046-8062-4146f3ad790a req-f0764a3f-8ca1-45bb-af8e-c48cae64a9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3796fc8-4043-411c-8b2f-ab1a7c61b5d0", "tag": "71d01f9d-35f9-4b9d-88de-bce736f58304"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:29:56.636718 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-e1d832cc-339b-4046-8062-4146f3ad790a req-f0764a3f-8ca1-45bb-af8e-c48cae64a9a0 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:56.637163 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-e1d832cc-339b-4046-8062-4146f3ad790a req-f0764a3f-8ca1-45bb-af8e-c48cae64a9a0 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:56.650047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-e1d832cc-339b-4046-8062-4146f3ad790a req-f0764a3f-8ca1-45bb-af8e-c48cae64a9a0 service nova] Creating event network-changed:71d01f9d-35f9-4b9d-88de-bce736f58304 for instance d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 on hv-cinder-80135 Jun 03 13:29:56.659715 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-e1d832cc-339b-4046-8062-4146f3ad790a req-f0764a3f-8ca1-45bb-af8e-c48cae64a9a0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046065 Jun 03 13:29:56.659715 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 445/830] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:29:56.736978 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-37f0a936-c145-4a31-8183-2ce88715c379 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:56.738479 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-37f0a936-c145-4a31-8183-2ce88715c379 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:56.745815 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-37f0a936-c145-4a31-8183-2ce88715c379 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:56.746416 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-37f0a936-c145-4a31-8183-2ce88715c379 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:56.747042 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-37f0a936-c145-4a31-8183-2ce88715c379 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:56.747484 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-37f0a936-c145-4a31-8183-2ce88715c379 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:57.004131 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-37f0a936-c145-4a31-8183-2ce88715c379 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:57.012079 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-37f0a936-c145-4a31-8183-2ce88715c379 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.279230 Jun 03 13:29:57.013244 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 386/831] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:56 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:57.053508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c12ca110-bf6a-46a0-9ceb-4a144212963b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:57.054233 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c12ca110-bf6a-46a0-9ceb-4a144212963b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:57.061804 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c12ca110-bf6a-46a0-9ceb-4a144212963b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:57.062282 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c12ca110-bf6a-46a0-9ceb-4a144212963b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:57.063065 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c12ca110-bf6a-46a0-9ceb-4a144212963b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:57.063507 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c12ca110-bf6a-46a0-9ceb-4a144212963b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:57.207621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c12ca110-bf6a-46a0-9ceb-4a144212963b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:57.215640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c12ca110-bf6a-46a0-9ceb-4a144212963b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:57.217949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c12ca110-bf6a-46a0-9ceb-4a144212963b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:57.219276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c12ca110-bf6a-46a0-9ceb-4a144212963b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.171487 Jun 03 13:29:57.219937 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 446/832] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:29:57 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:29:58.029892 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-5a2bb1f0-9ec1-4666-abdc-6c49564503bb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:58.030547 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-5a2bb1f0-9ec1-4666-abdc-6c49564503bb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:58.037959 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5a2bb1f0-9ec1-4666-abdc-6c49564503bb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:58.038453 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5a2bb1f0-9ec1-4666-abdc-6c49564503bb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:58.039187 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5a2bb1f0-9ec1-4666-abdc-6c49564503bb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:58.039629 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5a2bb1f0-9ec1-4666-abdc-6c49564503bb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:58.167908 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5a2bb1f0-9ec1-4666-abdc-6c49564503bb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:58.175768 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-5a2bb1f0-9ec1-4666-abdc-6c49564503bb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.149769 Jun 03 13:29:58.176377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 387/833] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:58 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:58.238403 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c9a79dd3-e823-423e-b998-03bdec2cae6b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:58.239004 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c9a79dd3-e823-423e-b998-03bdec2cae6b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:58.245545 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9a79dd3-e823-423e-b998-03bdec2cae6b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:58.245988 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9a79dd3-e823-423e-b998-03bdec2cae6b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:58.246742 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9a79dd3-e823-423e-b998-03bdec2cae6b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:58.247178 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9a79dd3-e823-423e-b998-03bdec2cae6b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:58.392505 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c9a79dd3-e823-423e-b998-03bdec2cae6b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:58.401323 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c9a79dd3-e823-423e-b998-03bdec2cae6b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:58.402966 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c9a79dd3-e823-423e-b998-03bdec2cae6b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:58.404122 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c9a79dd3-e823-423e-b998-03bdec2cae6b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.170040 Jun 03 13:29:58.404706 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 447/834] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:29:58 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:29:59.193488 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-001448f2-a991-4e7c-bbfd-c51ca668608b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:59.194132 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-001448f2-a991-4e7c-bbfd-c51ca668608b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:59.200547 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-001448f2-a991-4e7c-bbfd-c51ca668608b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:59.201002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-001448f2-a991-4e7c-bbfd-c51ca668608b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:59.201768 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-001448f2-a991-4e7c-bbfd-c51ca668608b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:59.202201 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-001448f2-a991-4e7c-bbfd-c51ca668608b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:59.337102 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-001448f2-a991-4e7c-bbfd-c51ca668608b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:59.344731 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-001448f2-a991-4e7c-bbfd-c51ca668608b tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.155731 Jun 03 13:29:59.345294 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 388/835] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:29:59 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:29:59.422825 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ac81f570-f35a-48c8-a394-b9132c1fae22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:29:59.423441 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ac81f570-f35a-48c8-a394-b9132c1fae22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:29:59.430592 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac81f570-f35a-48c8-a394-b9132c1fae22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:59.431044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac81f570-f35a-48c8-a394-b9132c1fae22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:59.431897 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac81f570-f35a-48c8-a394-b9132c1fae22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:29:59.432369 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac81f570-f35a-48c8-a394-b9132c1fae22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:29:59.562885 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ac81f570-f35a-48c8-a394-b9132c1fae22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:59.571706 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ac81f570-f35a-48c8-a394-b9132c1fae22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:59.573233 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ac81f570-f35a-48c8-a394-b9132c1fae22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:29:59.574421 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ac81f570-f35a-48c8-a394-b9132c1fae22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.155453 Jun 03 13:29:59.575001 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 448/836] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:29:59 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:00.362242 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f31a519b-4878-413b-be29-d4943c6f3625 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:00.363497 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f31a519b-4878-413b-be29-d4943c6f3625 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:00.370121 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f31a519b-4878-413b-be29-d4943c6f3625 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:00.370569 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f31a519b-4878-413b-be29-d4943c6f3625 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:00.371335 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f31a519b-4878-413b-be29-d4943c6f3625 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:00.371776 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f31a519b-4878-413b-be29-d4943c6f3625 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:00.508517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f31a519b-4878-413b-be29-d4943c6f3625 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:00.515995 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f31a519b-4878-413b-be29-d4943c6f3625 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.157586 Jun 03 13:30:00.516582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 389/837] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:00 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:00.593268 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d91dae0a-ec46-4041-841d-ef5bd511332e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:00.593808 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d91dae0a-ec46-4041-841d-ef5bd511332e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:00.605734 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d91dae0a-ec46-4041-841d-ef5bd511332e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:00.620048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d91dae0a-ec46-4041-841d-ef5bd511332e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:00.620048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d91dae0a-ec46-4041-841d-ef5bd511332e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:00.620048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d91dae0a-ec46-4041-841d-ef5bd511332e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:00.739989 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d91dae0a-ec46-4041-841d-ef5bd511332e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:00.747939 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d91dae0a-ec46-4041-841d-ef5bd511332e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:00.749466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d91dae0a-ec46-4041-841d-ef5bd511332e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:00.750627 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d91dae0a-ec46-4041-841d-ef5bd511332e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.161494 Jun 03 13:30:00.751438 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 449/838] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:00 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:01.532611 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4ace2d82-4677-48fd-8bd9-a6a113fb9b24 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:01.533217 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4ace2d82-4677-48fd-8bd9-a6a113fb9b24 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:01.540951 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ace2d82-4677-48fd-8bd9-a6a113fb9b24 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:01.541397 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ace2d82-4677-48fd-8bd9-a6a113fb9b24 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:01.542166 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ace2d82-4677-48fd-8bd9-a6a113fb9b24 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:01.542601 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ace2d82-4677-48fd-8bd9-a6a113fb9b24 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:01.562321 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:01.741538 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4ace2d82-4677-48fd-8bd9-a6a113fb9b24 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:01.749141 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4ace2d82-4677-48fd-8bd9-a6a113fb9b24 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.220513 Jun 03 13:30:01.750541 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 390/839] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:01 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:01.769629 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3fcb96d7-813e-42e7-a751-bdf047400115 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:01.770353 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3fcb96d7-813e-42e7-a751-bdf047400115 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:01.772874 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:01.777988 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3fcb96d7-813e-42e7-a751-bdf047400115 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:01.778433 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3fcb96d7-813e-42e7-a751-bdf047400115 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:01.779226 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3fcb96d7-813e-42e7-a751-bdf047400115 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:01.779692 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3fcb96d7-813e-42e7-a751-bdf047400115 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:01.799687 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:01.926479 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3fcb96d7-813e-42e7-a751-bdf047400115 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:01.932679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3fcb96d7-813e-42e7-a751-bdf047400115 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:01.934481 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3fcb96d7-813e-42e7-a751-bdf047400115 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:01.935731 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3fcb96d7-813e-42e7-a751-bdf047400115 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.170997 Jun 03 13:30:01.936341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 450/840] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:01 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:02.767371 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3ed34e67-9379-48c4-b1be-0b5b009773b5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:02.767990 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3ed34e67-9379-48c4-b1be-0b5b009773b5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:02.775271 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3ed34e67-9379-48c4-b1be-0b5b009773b5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:02.775798 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3ed34e67-9379-48c4-b1be-0b5b009773b5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:02.776596 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3ed34e67-9379-48c4-b1be-0b5b009773b5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:02.777043 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3ed34e67-9379-48c4-b1be-0b5b009773b5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:02.916520 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3ed34e67-9379-48c4-b1be-0b5b009773b5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:02.923863 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3ed34e67-9379-48c4-b1be-0b5b009773b5 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.161008 Jun 03 13:30:02.924438 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 391/841] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:02 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:02.958310 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-67a40ffd-4fed-49df-8c0d-8e91c97680d3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:02.958917 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-67a40ffd-4fed-49df-8c0d-8e91c97680d3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:02.960745 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=8 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:02.966522 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67a40ffd-4fed-49df-8c0d-8e91c97680d3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:02.966917 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67a40ffd-4fed-49df-8c0d-8e91c97680d3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:02.967675 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67a40ffd-4fed-49df-8c0d-8e91c97680d3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:02.968113 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67a40ffd-4fed-49df-8c0d-8e91c97680d3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:03.098691 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-67a40ffd-4fed-49df-8c0d-8e91c97680d3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:03.106858 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-67a40ffd-4fed-49df-8c0d-8e91c97680d3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:03.108399 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-67a40ffd-4fed-49df-8c0d-8e91c97680d3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:03.109563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-67a40ffd-4fed-49df-8c0d-8e91c97680d3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1746 microversion: 2.20 time: 0.156041 Jun 03 13:30:03.110172 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 451/842] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:02 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:03.940597 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e6737883-545b-40b7-a2f3-7c2a9e52260e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:03.941631 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e6737883-545b-40b7-a2f3-7c2a9e52260e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:03.948080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e6737883-545b-40b7-a2f3-7c2a9e52260e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:03.948561 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e6737883-545b-40b7-a2f3-7c2a9e52260e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:03.949321 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e6737883-545b-40b7-a2f3-7c2a9e52260e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:03.949761 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e6737883-545b-40b7-a2f3-7c2a9e52260e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:04.080349 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e6737883-545b-40b7-a2f3-7c2a9e52260e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:04.088377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e6737883-545b-40b7-a2f3-7c2a9e52260e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.151677 Jun 03 13:30:04.088941 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 392/843] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:03 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:04.131105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4ad2dd88-90fd-4a86-95c0-7439f70b348e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:04.131711 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4ad2dd88-90fd-4a86-95c0-7439f70b348e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:04.138578 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4ad2dd88-90fd-4a86-95c0-7439f70b348e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:04.139023 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4ad2dd88-90fd-4a86-95c0-7439f70b348e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:04.139771 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4ad2dd88-90fd-4a86-95c0-7439f70b348e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:04.140226 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4ad2dd88-90fd-4a86-95c0-7439f70b348e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:04.264323 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4ad2dd88-90fd-4a86-95c0-7439f70b348e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:04.272500 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4ad2dd88-90fd-4a86-95c0-7439f70b348e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:04.274018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4ad2dd88-90fd-4a86-95c0-7439f70b348e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:04.275185 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4ad2dd88-90fd-4a86-95c0-7439f70b348e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1746 microversion: 2.20 time: 0.149751 Jun 03 13:30:04.275753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 452/844] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:04 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:05.105273 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3bc93265-3ba8-4538-a317-054649775ce2 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:05.105888 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3bc93265-3ba8-4538-a317-054649775ce2 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:05.112431 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3bc93265-3ba8-4538-a317-054649775ce2 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:05.112886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3bc93265-3ba8-4538-a317-054649775ce2 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:05.113684 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3bc93265-3ba8-4538-a317-054649775ce2 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:05.114118 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3bc93265-3ba8-4538-a317-054649775ce2 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:05.246532 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3bc93265-3ba8-4538-a317-054649775ce2 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:05.254950 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3bc93265-3ba8-4538-a317-054649775ce2 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.153393 Jun 03 13:30:05.255386 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 393/845] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:05 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:05.293138 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7ec4f83a-59ca-4057-9daa-3a7ca6b2e094 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:05.293753 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7ec4f83a-59ca-4057-9daa-3a7ca6b2e094 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:05.300244 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7ec4f83a-59ca-4057-9daa-3a7ca6b2e094 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:05.300912 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7ec4f83a-59ca-4057-9daa-3a7ca6b2e094 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:05.301674 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7ec4f83a-59ca-4057-9daa-3a7ca6b2e094 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:05.302114 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7ec4f83a-59ca-4057-9daa-3a7ca6b2e094 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:05.434940 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7ec4f83a-59ca-4057-9daa-3a7ca6b2e094 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:05.444403 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7ec4f83a-59ca-4057-9daa-3a7ca6b2e094 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:05.445931 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7ec4f83a-59ca-4057-9daa-3a7ca6b2e094 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:05.447107 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7ec4f83a-59ca-4057-9daa-3a7ca6b2e094 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1746 microversion: 2.20 time: 0.157878 Jun 03 13:30:05.447672 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 453/846] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:05 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:05.507567 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-292407318", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "networks": [{"uuid": "658d84f7-9c35-43fe-9a55-961269f13341"}]}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:05.558569 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.network.neutron [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] validate_networks() for [('658d84f7-9c35-43fe-9a55-961269f13341', None, None, None, None, None)] {{(pid=118178) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:30:05.896836 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Flavor limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:30:05.897254 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Image limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:30:05.897748 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Flavor pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:30:05.898174 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Image pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:30:05.898608 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:30:05.907906 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:05.908384 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:05.909178 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:05.909609 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:05.926693 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Getting quotas for project 8db1c45b9113447b8ffc69365cf598bc. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:30:05.930627 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Getting quotas for user 1470975f53c44571be88b20b13d277c2 and project 8db1c45b9113447b8ffc69365cf598bc. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:30:05.941992 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Going to run 1 instances... {{(pid=118178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:30:05.944335 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:30:06.088166 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-06d7c4e2-6ce9-4105-9dd3-6f9f526e6944 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585246 Jun 03 13:30:06.088985 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 394/847] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:30:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:30:06.099639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2bbe0906-1905-46c7-8e24-880608bc946f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:06.100643 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2bbe0906-1905-46c7-8e24-880608bc946f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:06.154924 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2bbe0906-1905-46c7-8e24-880608bc946f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:06.163908 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2bbe0906-1905-46c7-8e24-880608bc946f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1213 microversion: 2.1 time: 0.068629 Jun 03 13:30:06.164742 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 454/848] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:06 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:06.271855 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-293f2db0-f9fd-473a-97ab-8086528c2755 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:06.272556 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-293f2db0-f9fd-473a-97ab-8086528c2755 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:06.278829 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-293f2db0-f9fd-473a-97ab-8086528c2755 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:06.279279 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-293f2db0-f9fd-473a-97ab-8086528c2755 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:06.280040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-293f2db0-f9fd-473a-97ab-8086528c2755 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:06.280506 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-293f2db0-f9fd-473a-97ab-8086528c2755 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:06.418171 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-293f2db0-f9fd-473a-97ab-8086528c2755 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:06.426105 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-293f2db0-f9fd-473a-97ab-8086528c2755 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.158319 Jun 03 13:30:06.426745 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 395/849] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:06 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:06.466381 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-cafed606-8ef4-4d18-a0ad-ed92e781af22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:06.467231 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-cafed606-8ef4-4d18-a0ad-ed92e781af22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:06.474794 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cafed606-8ef4-4d18-a0ad-ed92e781af22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:06.475276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cafed606-8ef4-4d18-a0ad-ed92e781af22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:06.476035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cafed606-8ef4-4d18-a0ad-ed92e781af22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:06.476505 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-cafed606-8ef4-4d18-a0ad-ed92e781af22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:06.607090 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cafed606-8ef4-4d18-a0ad-ed92e781af22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:06.615582 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cafed606-8ef4-4d18-a0ad-ed92e781af22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:06.617078 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-cafed606-8ef4-4d18-a0ad-ed92e781af22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:06.618244 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-cafed606-8ef4-4d18-a0ad-ed92e781af22 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1746 microversion: 2.20 time: 0.155926 Jun 03 13:30:06.618812 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 455/850] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:06 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:07.181232 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f2d2aac5-14e9-406f-8df9-9847e04fbc87 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:07.185436 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f2d2aac5-14e9-406f-8df9-9847e04fbc87 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:07.188537 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f2d2aac5-14e9-406f-8df9-9847e04fbc87 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:07.189035 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f2d2aac5-14e9-406f-8df9-9847e04fbc87 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:07.189812 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f2d2aac5-14e9-406f-8df9-9847e04fbc87 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:07.190350 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f2d2aac5-14e9-406f-8df9-9847e04fbc87 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:07.257359 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f2d2aac5-14e9-406f-8df9-9847e04fbc87 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:07.265101 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f2d2aac5-14e9-406f-8df9-9847e04fbc87 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1217 microversion: 2.1 time: 0.087937 Jun 03 13:30:07.265670 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 396/851] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:07 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:07.394314 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c6580cfe-364c-4141-a677-f69bee6b05c2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:07.394802 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c6580cfe-364c-4141-a677-f69bee6b05c2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:07.400941 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c6580cfe-364c-4141-a677-f69bee6b05c2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:07.401390 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c6580cfe-364c-4141-a677-f69bee6b05c2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:07.402149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c6580cfe-364c-4141-a677-f69bee6b05c2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:07.402700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c6580cfe-364c-4141-a677-f69bee6b05c2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:07.426188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c6580cfe-364c-4141-a677-f69bee6b05c2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/ips" status: 200 len: 150 microversion: 2.1 time: 0.035369 Jun 03 13:30:07.426842 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 456/852] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 13:30:07 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:07.443613 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-424fcb0b-48b6-4f3d-b996-ec3c5cca7114 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:07.448447 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-424fcb0b-48b6-4f3d-b996-ec3c5cca7114 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:07.455060 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-424fcb0b-48b6-4f3d-b996-ec3c5cca7114 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:07.455499 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-424fcb0b-48b6-4f3d-b996-ec3c5cca7114 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:07.456306 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-424fcb0b-48b6-4f3d-b996-ec3c5cca7114 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:07.457041 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-424fcb0b-48b6-4f3d-b996-ec3c5cca7114 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:07.637028 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-aa522b16-6e64-46f9-ac16-d4975e032884 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:07.638594 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-aa522b16-6e64-46f9-ac16-d4975e032884 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:07.647710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aa522b16-6e64-46f9-ac16-d4975e032884 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:07.649916 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aa522b16-6e64-46f9-ac16-d4975e032884 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:07.651007 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aa522b16-6e64-46f9-ac16-d4975e032884 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:07.651575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aa522b16-6e64-46f9-ac16-d4975e032884 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:07.694985 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-424fcb0b-48b6-4f3d-b996-ec3c5cca7114 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:07.706495 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-424fcb0b-48b6-4f3d-b996-ec3c5cca7114 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.267525 Jun 03 13:30:07.710230 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 397/853] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:07 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:07.809689 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-aa522b16-6e64-46f9-ac16-d4975e032884 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:07.819963 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-aa522b16-6e64-46f9-ac16-d4975e032884 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:07.821973 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-aa522b16-6e64-46f9-ac16-d4975e032884 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:07.823272 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-aa522b16-6e64-46f9-ac16-d4975e032884 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1746 microversion: 2.20 time: 0.190356 Jun 03 13:30:07.824135 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 457/854] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:07 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1746 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:08.225302 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-c73584d8-08d1-49c2-b535-49676a28a016 req-50b93f60-6151-42e0-9eb5-994af32685c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f51fd4a-3353-43f3-b528-c767e6b916d8", "name": "network-vif-plugged", "status": "completed", "tag": "173fe60e-b29a-407d-93fa-37787cf955ce"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:08.233784 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-c73584d8-08d1-49c2-b535-49676a28a016 req-50b93f60-6151-42e0-9eb5-994af32685c0 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:08.237259 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-c73584d8-08d1-49c2-b535-49676a28a016 req-50b93f60-6151-42e0-9eb5-994af32685c0 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:08.247147 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-c73584d8-08d1-49c2-b535-49676a28a016 req-50b93f60-6151-42e0-9eb5-994af32685c0 service nova] Creating event network-vif-plugged:173fe60e-b29a-407d-93fa-37787cf955ce for instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 on hv-cinder-80135 Jun 03 13:30:08.252443 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-c73584d8-08d1-49c2-b535-49676a28a016 req-50b93f60-6151-42e0-9eb5-994af32685c0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031702 Jun 03 13:30:08.253082 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 398/855] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:08.281916 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e6fc0c84-3545-4322-94d2-35aec321c387 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:08.282629 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e6fc0c84-3545-4322-94d2-35aec321c387 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:08.291584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6fc0c84-3545-4322-94d2-35aec321c387 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:08.292041 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6fc0c84-3545-4322-94d2-35aec321c387 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:08.292896 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6fc0c84-3545-4322-94d2-35aec321c387 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:08.293334 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6fc0c84-3545-4322-94d2-35aec321c387 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:08.357049 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e6fc0c84-3545-4322-94d2-35aec321c387 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:08.365486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e6fc0c84-3545-4322-94d2-35aec321c387 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1265 microversion: 2.1 time: 0.087488 Jun 03 13:30:08.366283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 458/856] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:08 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:08.727820 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1a8b0ebd-2926-4bfc-b610-fc73a797592e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:08.728539 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-1a8b0ebd-2926-4bfc-b610-fc73a797592e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:08.734750 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1a8b0ebd-2926-4bfc-b610-fc73a797592e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:08.735194 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1a8b0ebd-2926-4bfc-b610-fc73a797592e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:08.735946 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1a8b0ebd-2926-4bfc-b610-fc73a797592e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:08.736402 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1a8b0ebd-2926-4bfc-b610-fc73a797592e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:08.843111 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4063ddcd-b74b-43ae-b25e-201efa6cb706 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:08.843817 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4063ddcd-b74b-43ae-b25e-201efa6cb706 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:08.851927 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4063ddcd-b74b-43ae-b25e-201efa6cb706 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:08.852436 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4063ddcd-b74b-43ae-b25e-201efa6cb706 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:08.853221 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4063ddcd-b74b-43ae-b25e-201efa6cb706 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:08.853667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-4063ddcd-b74b-43ae-b25e-201efa6cb706 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:08.893150 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-1a8b0ebd-2926-4bfc-b610-fc73a797592e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:08.904601 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-1a8b0ebd-2926-4bfc-b610-fc73a797592e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.182112 Jun 03 13:30:08.915189 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 399/857] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:08 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:09.027778 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4063ddcd-b74b-43ae-b25e-201efa6cb706 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:09.031679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4063ddcd-b74b-43ae-b25e-201efa6cb706 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:09.040594 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4063ddcd-b74b-43ae-b25e-201efa6cb706 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:09.042487 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4063ddcd-b74b-43ae-b25e-201efa6cb706 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1746 microversion: 2.20 time: 0.202976 Jun 03 13:30:09.044699 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 459/858] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:08 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1746 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:09.383533 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-01f1e695-dfe6-482c-9bd7-d01eb66e9cf8 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:09.384190 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-01f1e695-dfe6-482c-9bd7-d01eb66e9cf8 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:09.390593 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-01f1e695-dfe6-482c-9bd7-d01eb66e9cf8 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:09.391350 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-01f1e695-dfe6-482c-9bd7-d01eb66e9cf8 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:09.392210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-01f1e695-dfe6-482c-9bd7-d01eb66e9cf8 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:09.392840 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-01f1e695-dfe6-482c-9bd7-d01eb66e9cf8 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:09.469387 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-01f1e695-dfe6-482c-9bd7-d01eb66e9cf8 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:09.477273 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-01f1e695-dfe6-482c-9bd7-d01eb66e9cf8 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1271 microversion: 2.1 time: 0.098141 Jun 03 13:30:09.477837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 400/859] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:09 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:09.923314 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a980bf55-c000-4aaa-b1a3-93a95aba4dea tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:09.924776 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a980bf55-c000-4aaa-b1a3-93a95aba4dea tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:09.932956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a980bf55-c000-4aaa-b1a3-93a95aba4dea tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:09.933787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a980bf55-c000-4aaa-b1a3-93a95aba4dea tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:09.934640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a980bf55-c000-4aaa-b1a3-93a95aba4dea tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:09.935143 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a980bf55-c000-4aaa-b1a3-93a95aba4dea tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:10.063183 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8f4d6c31-1e03-4a23-9ee7-39cc7f1b5345 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:10.064807 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8f4d6c31-1e03-4a23-9ee7-39cc7f1b5345 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:10.078652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8f4d6c31-1e03-4a23-9ee7-39cc7f1b5345 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:10.081447 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8f4d6c31-1e03-4a23-9ee7-39cc7f1b5345 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:10.082334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8f4d6c31-1e03-4a23-9ee7-39cc7f1b5345 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:10.082780 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8f4d6c31-1e03-4a23-9ee7-39cc7f1b5345 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:10.164539 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a980bf55-c000-4aaa-b1a3-93a95aba4dea tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:10.174265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a980bf55-c000-4aaa-b1a3-93a95aba4dea tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.255363 Jun 03 13:30:10.181741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 460/860] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:09 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:10.235233 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9246d620-0166-4201-a20d-23d51b8e7dfc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b86a1735-2f0c-4f8a-bc77-3d1a5e974e59"}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:10.236757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9246d620-0166-4201-a20d-23d51b8e7dfc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:10.244552 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9246d620-0166-4201-a20d-23d51b8e7dfc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:10.245294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9246d620-0166-4201-a20d-23d51b8e7dfc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:10.246236 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9246d620-0166-4201-a20d-23d51b8e7dfc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:10.246846 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9246d620-0166-4201-a20d-23d51b8e7dfc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:10.470381 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8f4d6c31-1e03-4a23-9ee7-39cc7f1b5345 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:10.487183 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8f4d6c31-1e03-4a23-9ee7-39cc7f1b5345 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:10.487183 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8f4d6c31-1e03-4a23-9ee7-39cc7f1b5345 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:10.487183 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8f4d6c31-1e03-4a23-9ee7-39cc7f1b5345 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1741 microversion: 2.20 time: 0.426185 Jun 03 13:30:10.497339 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 401/861] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:10 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1741 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:10.508788 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-7421985a-53ea-4a66-b509-690055d03808 req-c0525ec3-32c0-412d-b154-fc6ac31a8635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3796fc8-4043-411c-8b2f-ab1a7c61b5d0", "name": "network-vif-plugged", "status": "completed", "tag": "71d01f9d-35f9-4b9d-88de-bce736f58304"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:10.518213 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-7421985a-53ea-4a66-b509-690055d03808 req-c0525ec3-32c0-412d-b154-fc6ac31a8635 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:10.518941 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-7421985a-53ea-4a66-b509-690055d03808 req-c0525ec3-32c0-412d-b154-fc6ac31a8635 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:10.535300 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-7421985a-53ea-4a66-b509-690055d03808 req-c0525ec3-32c0-412d-b154-fc6ac31a8635 service nova] Creating event network-vif-plugged:71d01f9d-35f9-4b9d-88de-bce736f58304 for instance d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 on hv-cinder-80135 Jun 03 13:30:10.541735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-7421985a-53ea-4a66-b509-690055d03808 req-c0525ec3-32c0-412d-b154-fc6ac31a8635 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042729 Jun 03 13:30:10.542525 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 402/862] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:10.552851 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0f3bcd9c-f655-43da-94aa-36dcd92c8358 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:10.553703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0f3bcd9c-f655-43da-94aa-36dcd92c8358 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:10.571926 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0f3bcd9c-f655-43da-94aa-36dcd92c8358 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:10.572545 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0f3bcd9c-f655-43da-94aa-36dcd92c8358 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:10.573770 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0f3bcd9c-f655-43da-94aa-36dcd92c8358 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:10.574637 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0f3bcd9c-f655-43da-94aa-36dcd92c8358 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:10.831203 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0f3bcd9c-f655-43da-94aa-36dcd92c8358 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:10.845990 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0f3bcd9c-f655-43da-94aa-36dcd92c8358 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1313 microversion: 2.1 time: 0.301866 Jun 03 13:30:10.846587 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 403/863] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:10 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:11.181961 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-aa319a73-dac0-4659-ae85-b6364f8e50cd req-5305f17d-d1c2-4e5e-bc0d-185338889274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db19e740-5ca9-47d0-bacd-e7c89c2eefac", "tag": "a29c2299-1961-4b3b-9e63-d15fca110d91"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:11.191709 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-aa319a73-dac0-4659-ae85-b6364f8e50cd req-5305f17d-d1c2-4e5e-bc0d-185338889274 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:11.193171 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-aa319a73-dac0-4659-ae85-b6364f8e50cd req-5305f17d-d1c2-4e5e-bc0d-185338889274 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:11.213354 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9246d620-0166-4201-a20d-23d51b8e7dfc tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.986643 Jun 03 13:30:11.214481 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 461/864] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:30:10 2022] POST /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments => generated 194 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:11.220081 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-18ad5216-8c00-45b5-9fd1-d680676ecf63 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:11.221520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-18ad5216-8c00-45b5-9fd1-d680676ecf63 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:11.228784 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-aa319a73-dac0-4659-ae85-b6364f8e50cd req-5305f17d-d1c2-4e5e-bc0d-185338889274 service nova] Creating event network-changed:a29c2299-1961-4b3b-9e63-d15fca110d91 for instance db19e740-5ca9-47d0-bacd-e7c89c2eefac on hv-cinder-80135 Jun 03 13:30:11.229629 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-18ad5216-8c00-45b5-9fd1-d680676ecf63 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:11.230304 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-18ad5216-8c00-45b5-9fd1-d680676ecf63 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:11.231646 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-18ad5216-8c00-45b5-9fd1-d680676ecf63 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:11.232294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-18ad5216-8c00-45b5-9fd1-d680676ecf63 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:11.234235 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-aa319a73-dac0-4659-ae85-b6364f8e50cd req-5305f17d-d1c2-4e5e-bc0d-185338889274 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055868 Jun 03 13:30:11.240501 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 404/865] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:11.394339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-18ad5216-8c00-45b5-9fd1-d680676ecf63 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:11.401983 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-18ad5216-8c00-45b5-9fd1-d680676ecf63 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.186111 Jun 03 13:30:11.402803 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 462/866] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:11 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:11.505821 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-5bede574-0e2b-4019-9b14-90ac682cc337 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:11.507215 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-5bede574-0e2b-4019-9b14-90ac682cc337 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:11.518085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5bede574-0e2b-4019-9b14-90ac682cc337 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:11.518085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5bede574-0e2b-4019-9b14-90ac682cc337 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:11.518968 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5bede574-0e2b-4019-9b14-90ac682cc337 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:11.519932 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5bede574-0e2b-4019-9b14-90ac682cc337 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:11.679367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5bede574-0e2b-4019-9b14-90ac682cc337 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:11.689031 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5bede574-0e2b-4019-9b14-90ac682cc337 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:11.690757 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5bede574-0e2b-4019-9b14-90ac682cc337 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:11.692493 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-5bede574-0e2b-4019-9b14-90ac682cc337 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1741 microversion: 2.20 time: 0.191770 Jun 03 13:30:11.694742 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 405/867] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:11 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:11.866621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d52b7d18-51bb-4b62-aa3a-2c7ad437fa93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:11.866621 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d52b7d18-51bb-4b62-aa3a-2c7ad437fa93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:11.868248 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:11.873570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d52b7d18-51bb-4b62-aa3a-2c7ad437fa93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:11.873902 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d52b7d18-51bb-4b62-aa3a-2c7ad437fa93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:11.874888 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d52b7d18-51bb-4b62-aa3a-2c7ad437fa93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:11.875330 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d52b7d18-51bb-4b62-aa3a-2c7ad437fa93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:12.026656 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d52b7d18-51bb-4b62-aa3a-2c7ad437fa93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:12.035486 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d52b7d18-51bb-4b62-aa3a-2c7ad437fa93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1313 microversion: 2.1 time: 0.176353 Jun 03 13:30:12.036325 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 463/868] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:11 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:12.420411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3138ace6-93ad-45f2-846d-26068380962e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:12.422061 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3138ace6-93ad-45f2-846d-26068380962e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:12.424828 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:12.430095 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3138ace6-93ad-45f2-846d-26068380962e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:12.430608 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3138ace6-93ad-45f2-846d-26068380962e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:12.431457 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3138ace6-93ad-45f2-846d-26068380962e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:12.432096 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3138ace6-93ad-45f2-846d-26068380962e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:12.627918 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3138ace6-93ad-45f2-846d-26068380962e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:12.638973 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3138ace6-93ad-45f2-846d-26068380962e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1264 microversion: 2.1 time: 0.221815 Jun 03 13:30:12.649917 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 406/869] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:12 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:12.714796 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-94fbfaa4-4afd-4e29-9aa1-8cc899f977cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:12.716124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-94fbfaa4-4afd-4e29-9aa1-8cc899f977cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:12.732671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-94fbfaa4-4afd-4e29-9aa1-8cc899f977cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:12.733562 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-94fbfaa4-4afd-4e29-9aa1-8cc899f977cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:12.734545 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-94fbfaa4-4afd-4e29-9aa1-8cc899f977cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:12.735136 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-94fbfaa4-4afd-4e29-9aa1-8cc899f977cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:12.916198 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-94fbfaa4-4afd-4e29-9aa1-8cc899f977cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:12.924941 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-94fbfaa4-4afd-4e29-9aa1-8cc899f977cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:12.926821 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-94fbfaa4-4afd-4e29-9aa1-8cc899f977cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:12.928296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-94fbfaa4-4afd-4e29-9aa1-8cc899f977cf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1741 microversion: 2.20 time: 0.220563 Jun 03 13:30:12.940640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 464/870] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:12 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:13.057880 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-33c14973-2ddb-400e-acb1-36fbaf302e33 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:13.060355 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-33c14973-2ddb-400e-acb1-36fbaf302e33 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:13.067587 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-33c14973-2ddb-400e-acb1-36fbaf302e33 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:13.068458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-33c14973-2ddb-400e-acb1-36fbaf302e33 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:13.070113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-33c14973-2ddb-400e-acb1-36fbaf302e33 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:13.070720 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-33c14973-2ddb-400e-acb1-36fbaf302e33 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:13.337650 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-33c14973-2ddb-400e-acb1-36fbaf302e33 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:13.346820 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-33c14973-2ddb-400e-acb1-36fbaf302e33 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1313 microversion: 2.1 time: 0.296158 Jun 03 13:30:13.348004 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 407/871] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:13 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:13.664926 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9080ce4c-f2d2-4f73-923e-777150317e5a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:13.666899 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9080ce4c-f2d2-4f73-923e-777150317e5a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:13.676553 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9080ce4c-f2d2-4f73-923e-777150317e5a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:13.677331 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9080ce4c-f2d2-4f73-923e-777150317e5a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:13.678519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9080ce4c-f2d2-4f73-923e-777150317e5a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:13.679245 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9080ce4c-f2d2-4f73-923e-777150317e5a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:13.855167 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9080ce4c-f2d2-4f73-923e-777150317e5a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:13.864720 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9080ce4c-f2d2-4f73-923e-777150317e5a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1450 microversion: 2.1 time: 0.211271 Jun 03 13:30:13.877806 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 465/872] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:13 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1450 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:13.885232 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8e58c1a0-07a3-45da-bf2b-7733ec64ee9c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:13.886393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8e58c1a0-07a3-45da-bf2b-7733ec64ee9c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:13.893490 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e58c1a0-07a3-45da-bf2b-7733ec64ee9c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:13.893932 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e58c1a0-07a3-45da-bf2b-7733ec64ee9c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:13.894747 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e58c1a0-07a3-45da-bf2b-7733ec64ee9c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:13.895340 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e58c1a0-07a3-45da-bf2b-7733ec64ee9c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:13.956935 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e1db26fb-7306-4b11-a6a4-050718b6afe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:13.958167 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e1db26fb-7306-4b11-a6a4-050718b6afe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:13.979388 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e1db26fb-7306-4b11-a6a4-050718b6afe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:13.980557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e1db26fb-7306-4b11-a6a4-050718b6afe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:13.983795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e1db26fb-7306-4b11-a6a4-050718b6afe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:13.984449 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e1db26fb-7306-4b11-a6a4-050718b6afe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:14.113965 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8e58c1a0-07a3-45da-bf2b-7733ec64ee9c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:14.122159 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8e58c1a0-07a3-45da-bf2b-7733ec64ee9c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1450 microversion: 2.1 time: 0.242037 Jun 03 13:30:14.144868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 408/873] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:13 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1450 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:14.207240 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e1db26fb-7306-4b11-a6a4-050718b6afe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:14.216569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e1db26fb-7306-4b11-a6a4-050718b6afe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:14.219279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e1db26fb-7306-4b11-a6a4-050718b6afe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:14.221346 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e1db26fb-7306-4b11-a6a4-050718b6afe1 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1741 microversion: 2.20 time: 0.274629 Jun 03 13:30:14.233253 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 466/874] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:13 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1741 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:14.362709 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a701f224-7096-4d11-b053-18f92b85210a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:14.364277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a701f224-7096-4d11-b053-18f92b85210a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:14.372910 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a701f224-7096-4d11-b053-18f92b85210a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:14.373604 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a701f224-7096-4d11-b053-18f92b85210a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:14.374138 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a701f224-7096-4d11-b053-18f92b85210a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:14.374579 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a701f224-7096-4d11-b053-18f92b85210a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:14.844369 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a701f224-7096-4d11-b053-18f92b85210a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:14.849758 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=100 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:14.855786 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a701f224-7096-4d11-b053-18f92b85210a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1313 microversion: 2.1 time: 0.496124 Jun 03 13:30:14.857865 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 409/875] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:14 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:15.240372 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-98bc531b-2d06-4d95-94f8-7f03ffda4a88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:15.240988 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-98bc531b-2d06-4d95-94f8-7f03ffda4a88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:15.251269 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-98bc531b-2d06-4d95-94f8-7f03ffda4a88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:15.251972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-98bc531b-2d06-4d95-94f8-7f03ffda4a88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:15.252795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-98bc531b-2d06-4d95-94f8-7f03ffda4a88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:15.253236 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-98bc531b-2d06-4d95-94f8-7f03ffda4a88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:15.264925 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:15.426457 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-98bc531b-2d06-4d95-94f8-7f03ffda4a88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:15.435109 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-98bc531b-2d06-4d95-94f8-7f03ffda4a88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:15.436657 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-98bc531b-2d06-4d95-94f8-7f03ffda4a88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:15.437987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-98bc531b-2d06-4d95-94f8-7f03ffda4a88 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1741 microversion: 2.20 time: 0.201833 Jun 03 13:30:15.449785 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 467/876] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:15 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:15.874389 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6cfe6bd7-8ebd-474d-bd78-9fb4be190f07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:15.875002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6cfe6bd7-8ebd-474d-bd78-9fb4be190f07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:15.883029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6cfe6bd7-8ebd-474d-bd78-9fb4be190f07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:15.883478 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6cfe6bd7-8ebd-474d-bd78-9fb4be190f07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:15.884265 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6cfe6bd7-8ebd-474d-bd78-9fb4be190f07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:15.884706 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6cfe6bd7-8ebd-474d-bd78-9fb4be190f07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:15.917320 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:15.937441 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=6 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:16.182319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6cfe6bd7-8ebd-474d-bd78-9fb4be190f07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:16.191919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6cfe6bd7-8ebd-474d-bd78-9fb4be190f07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1313 microversion: 2.1 time: 0.320723 Jun 03 13:30:16.192698 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 410/877] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:15 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:16.457924 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8af1ffe4-dc4e-494f-b079-738a93f2bdf4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:16.459149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8af1ffe4-dc4e-494f-b079-738a93f2bdf4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:16.461357 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:16.466763 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8af1ffe4-dc4e-494f-b079-738a93f2bdf4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:16.467163 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8af1ffe4-dc4e-494f-b079-738a93f2bdf4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:16.467944 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8af1ffe4-dc4e-494f-b079-738a93f2bdf4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:16.468422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8af1ffe4-dc4e-494f-b079-738a93f2bdf4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:16.632389 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8af1ffe4-dc4e-494f-b079-738a93f2bdf4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:16.639944 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8af1ffe4-dc4e-494f-b079-738a93f2bdf4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:16.642309 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8af1ffe4-dc4e-494f-b079-738a93f2bdf4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:16.643511 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8af1ffe4-dc4e-494f-b079-738a93f2bdf4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1741 microversion: 2.20 time: 0.190106 Jun 03 13:30:16.660236 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 468/878] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:16 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:16.749332 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-b19f976f-d30f-4305-9dd8-0912c2e4d078 req-749c70c9-7891-40d0-b937-48978fd0717a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3796fc8-4043-411c-8b2f-ab1a7c61b5d0", "tag": "71d01f9d-35f9-4b9d-88de-bce736f58304"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:16.765578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-b19f976f-d30f-4305-9dd8-0912c2e4d078 req-749c70c9-7891-40d0-b937-48978fd0717a service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:16.780491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-b19f976f-d30f-4305-9dd8-0912c2e4d078 req-749c70c9-7891-40d0-b937-48978fd0717a service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:16.786348 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-b19f976f-d30f-4305-9dd8-0912c2e4d078 req-749c70c9-7891-40d0-b937-48978fd0717a service nova] Creating event network-changed:71d01f9d-35f9-4b9d-88de-bce736f58304 for instance d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 on hv-cinder-80135 Jun 03 13:30:16.792886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-b19f976f-d30f-4305-9dd8-0912c2e4d078 req-749c70c9-7891-40d0-b937-48978fd0717a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047248 Jun 03 13:30:16.793914 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 411/879] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:17.211689 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-bec25ce3-d8f7-4766-8cb1-b1ad781a9e9e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:17.215233 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-bec25ce3-d8f7-4766-8cb1-b1ad781a9e9e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:17.231777 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bec25ce3-d8f7-4766-8cb1-b1ad781a9e9e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:17.235494 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bec25ce3-d8f7-4766-8cb1-b1ad781a9e9e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:17.236473 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bec25ce3-d8f7-4766-8cb1-b1ad781a9e9e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:17.236997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bec25ce3-d8f7-4766-8cb1-b1ad781a9e9e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:17.434948 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-bec25ce3-d8f7-4766-8cb1-b1ad781a9e9e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:17.447639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-bec25ce3-d8f7-4766-8cb1-b1ad781a9e9e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1313 microversion: 2.1 time: 0.241196 Jun 03 13:30:17.453228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 469/880] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:17 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:17.665231 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ec0424a1-57d3-494e-a5d2-be3db82f7299 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:17.665934 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ec0424a1-57d3-494e-a5d2-be3db82f7299 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:17.673188 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ec0424a1-57d3-494e-a5d2-be3db82f7299 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:17.673661 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ec0424a1-57d3-494e-a5d2-be3db82f7299 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:17.674561 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ec0424a1-57d3-494e-a5d2-be3db82f7299 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:17.675184 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ec0424a1-57d3-494e-a5d2-be3db82f7299 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:17.862061 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ec0424a1-57d3-494e-a5d2-be3db82f7299 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:17.873857 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ec0424a1-57d3-494e-a5d2-be3db82f7299 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:17.875840 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ec0424a1-57d3-494e-a5d2-be3db82f7299 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:17.877557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ec0424a1-57d3-494e-a5d2-be3db82f7299 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1741 microversion: 2.20 time: 0.219147 Jun 03 13:30:17.878215 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 412/881] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:17 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:18.471120 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-89848b85-ca1d-495c-8361-a5fdf87e1885 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:18.471736 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-89848b85-ca1d-495c-8361-a5fdf87e1885 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:18.479614 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-89848b85-ca1d-495c-8361-a5fdf87e1885 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:18.480062 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-89848b85-ca1d-495c-8361-a5fdf87e1885 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:18.480854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-89848b85-ca1d-495c-8361-a5fdf87e1885 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:18.481289 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-89848b85-ca1d-495c-8361-a5fdf87e1885 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:18.639169 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-89848b85-ca1d-495c-8361-a5fdf87e1885 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:18.649310 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-89848b85-ca1d-495c-8361-a5fdf87e1885 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1313 microversion: 2.1 time: 0.182328 Jun 03 13:30:18.650684 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 470/882] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:18 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:18.898927 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d83def45-9f80-49c4-85ef-a9f0c7b05aba tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:18.899903 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d83def45-9f80-49c4-85ef-a9f0c7b05aba tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:18.907956 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d83def45-9f80-49c4-85ef-a9f0c7b05aba tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:18.908908 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d83def45-9f80-49c4-85ef-a9f0c7b05aba tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:18.910427 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d83def45-9f80-49c4-85ef-a9f0c7b05aba tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:18.911164 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d83def45-9f80-49c4-85ef-a9f0c7b05aba tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:19.109291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d83def45-9f80-49c4-85ef-a9f0c7b05aba tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:19.119159 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d83def45-9f80-49c4-85ef-a9f0c7b05aba tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:19.121731 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d83def45-9f80-49c4-85ef-a9f0c7b05aba tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:19.123377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d83def45-9f80-49c4-85ef-a9f0c7b05aba tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1741 microversion: 2.20 time: 0.230216 Jun 03 13:30:19.135521 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 413/883] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:18 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1741 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:19.666109 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ad607673-179f-4f35-acb0-8e591da28d72 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:19.666852 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ad607673-179f-4f35-acb0-8e591da28d72 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:19.673553 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ad607673-179f-4f35-acb0-8e591da28d72 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:19.674035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ad607673-179f-4f35-acb0-8e591da28d72 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:19.674977 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ad607673-179f-4f35-acb0-8e591da28d72 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:19.675637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ad607673-179f-4f35-acb0-8e591da28d72 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:19.824434 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ad607673-179f-4f35-acb0-8e591da28d72 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:19.852088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ad607673-179f-4f35-acb0-8e591da28d72 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1313 microversion: 2.1 time: 0.189762 Jun 03 13:30:19.857633 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 471/884] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:19 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:20.143007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3ed7fdef-73c9-4123-a7ef-fe0a04ac3a5c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:20.144522 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3ed7fdef-73c9-4123-a7ef-fe0a04ac3a5c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:20.155618 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3ed7fdef-73c9-4123-a7ef-fe0a04ac3a5c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:20.156071 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3ed7fdef-73c9-4123-a7ef-fe0a04ac3a5c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:20.156886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3ed7fdef-73c9-4123-a7ef-fe0a04ac3a5c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:20.157323 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3ed7fdef-73c9-4123-a7ef-fe0a04ac3a5c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:20.329455 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3ed7fdef-73c9-4123-a7ef-fe0a04ac3a5c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:20.341099 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3ed7fdef-73c9-4123-a7ef-fe0a04ac3a5c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:20.342639 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3ed7fdef-73c9-4123-a7ef-fe0a04ac3a5c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:20.343940 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3ed7fdef-73c9-4123-a7ef-fe0a04ac3a5c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1741 microversion: 2.20 time: 0.205575 Jun 03 13:30:20.344774 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 414/885] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:20 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:20.479757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-e85a0510-f077-46ae-bf89-506d1d5e173d req-de1fecef-eef4-4021-8ac9-e34201884e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db19e740-5ca9-47d0-bacd-e7c89c2eefac", "name": "network-vif-plugged", "status": "completed", "tag": "a29c2299-1961-4b3b-9e63-d15fca110d91"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:20.493564 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-e85a0510-f077-46ae-bf89-506d1d5e173d req-de1fecef-eef4-4021-8ac9-e34201884e7c service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:20.494514 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-e85a0510-f077-46ae-bf89-506d1d5e173d req-de1fecef-eef4-4021-8ac9-e34201884e7c service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:20.505905 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-e85a0510-f077-46ae-bf89-506d1d5e173d req-de1fecef-eef4-4021-8ac9-e34201884e7c service nova] Creating event network-vif-plugged:a29c2299-1961-4b3b-9e63-d15fca110d91 for instance db19e740-5ca9-47d0-bacd-e7c89c2eefac on hv-cinder-80135 Jun 03 13:30:20.511617 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-e85a0510-f077-46ae-bf89-506d1d5e173d req-de1fecef-eef4-4021-8ac9-e34201884e7c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037563 Jun 03 13:30:20.512590 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 472/886] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:20.875892 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f003ceda-214f-4df7-93ba-7551b9df360f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:20.875892 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f003ceda-214f-4df7-93ba-7551b9df360f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:20.880016 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f003ceda-214f-4df7-93ba-7551b9df360f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:20.880497 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f003ceda-214f-4df7-93ba-7551b9df360f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:20.881716 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f003ceda-214f-4df7-93ba-7551b9df360f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:20.881876 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f003ceda-214f-4df7-93ba-7551b9df360f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:21.078881 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f003ceda-214f-4df7-93ba-7551b9df360f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:21.084139 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a1a6228e-bc23-4234-bdae-2a1f2e647a6f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b86a1735-2f0c-4f8a-bc77-3d1a5e974e59"}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:21.085451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a1a6228e-bc23-4234-bdae-2a1f2e647a6f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:21.087353 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f003ceda-214f-4df7-93ba-7551b9df360f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1313 microversion: 2.1 time: 0.221223 Jun 03 13:30:21.087934 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 415/887] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:20 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:21.092553 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a1a6228e-bc23-4234-bdae-2a1f2e647a6f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:21.093043 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a1a6228e-bc23-4234-bdae-2a1f2e647a6f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:21.093823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a1a6228e-bc23-4234-bdae-2a1f2e647a6f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:21.094265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a1a6228e-bc23-4234-bdae-2a1f2e647a6f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:21.177582 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-a1a6228e-bc23-4234-bdae-2a1f2e647a6f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Invalid volume: volume b86a1735-2f0c-4f8a-bc77-3d1a5e974e59 is already attached to instances: a9457ca1-60e7-419b-9c30-10d88085d7ba Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a1a6228e-bc23-4234-bdae-2a1f2e647a6f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: POST /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments HTTP/1.1 Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 74 Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:30:21.179423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:30:21.181199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:30:21.181199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:30:21.181199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:30:21.181199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:30:21.181199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:30:21.181199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:30:21.181199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:30:21.181199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:30:21.181199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:30:21.181199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Jun 03 13:30:21.181199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {"volumeAttachment": {"volumeId": "b86a1735-2f0c-4f8a-bc77-3d1a5e974e59"}} Jun 03 13:30:21.181199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Invalid volume: volume b86a1735-2f0c-4f8a-bc77-3d1a5e974e59 is already attached to instances: a9457ca1-60e7-419b-9c30-10d88085d7ba Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'server_id': 'a9457ca1-60e7-419b-9c30-10d88085d7ba', 'body': {'volumeAttachment': {'volumeId': 'b86a1735-2f0c-4f8a-bc77-3d1a5e974e59'}}} Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b86a1735-2f0c-4f8a-bc77-3d1a5e974e59 is already attached to instances: a9457ca1-60e7-419b-9c30-10d88085d7ba Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:30:21.182265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b86a1735-2f0c-4f8a-bc77-3d1a5e974e59 is already attached to instances: a9457ca1-60e7-419b-9c30-10d88085d7ba Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:30:21.183773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:30:21.185298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:30:21.185298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:30:21.185298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:30:21.185298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b86a1735-2f0c-4f8a-bc77-3d1a5e974e59 is already attached to instances: a9457ca1-60e7-419b-9c30-10d88085d7ba Jun 03 13:30:21.185298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:30:21.185298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a1a6228e-bc23-4234-bdae-2a1f2e647a6f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 400 to user: Invalid volume: volume b86a1735-2f0c-4f8a-bc77-3d1a5e974e59 is already attached to instances: a9457ca1-60e7-419b-9c30-10d88085d7ba {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:30:21.185298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a1a6228e-bc23-4234-bdae-2a1f2e647a6f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102153 Jun 03 13:30:21.185298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 473/888] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:30:21 2022] POST /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 03 13:30:21.242353 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-60ca21ee-2384-4304-a7c8-53116fba53d3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:21.242967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-60ca21ee-2384-4304-a7c8-53116fba53d3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:21.249413 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-60ca21ee-2384-4304-a7c8-53116fba53d3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:21.249856 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-60ca21ee-2384-4304-a7c8-53116fba53d3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:21.250613 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-60ca21ee-2384-4304-a7c8-53116fba53d3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:21.251322 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-60ca21ee-2384-4304-a7c8-53116fba53d3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:21.341784 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-60ca21ee-2384-4304-a7c8-53116fba53d3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lazy-loading 'services' on Instance uuid a9457ca1-60e7-419b-9c30-10d88085d7ba {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:30:21.363572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1f31d2da-e10a-45b7-ba25-0ff7849be70e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:21.364411 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-1f31d2da-e10a-45b7-ba25-0ff7849be70e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:21.370837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1f31d2da-e10a-45b7-ba25-0ff7849be70e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:21.371428 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1f31d2da-e10a-45b7-ba25-0ff7849be70e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:21.372384 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1f31d2da-e10a-45b7-ba25-0ff7849be70e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:21.372898 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1f31d2da-e10a-45b7-ba25-0ff7849be70e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:21.512203 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1f31d2da-e10a-45b7-ba25-0ff7849be70e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:21.520610 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1f31d2da-e10a-45b7-ba25-0ff7849be70e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:21.522158 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1f31d2da-e10a-45b7-ba25-0ff7849be70e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:21.523335 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1f31d2da-e10a-45b7-ba25-0ff7849be70e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1741 microversion: 2.20 time: 0.164423 Jun 03 13:30:21.524099 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 474/889] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:21 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:21.660950 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-60ca21ee-2384-4304-a7c8-53116fba53d3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments/b86a1735-2f0c-4f8a-bc77-3d1a5e974e59" status: 202 len: 0 microversion: 2.1 time: 0.422564 Jun 03 13:30:21.667957 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 416/890] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 13:30:21 2022] DELETE /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments/b86a1735-2f0c-4f8a-bc77-3d1a5e974e59 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:30:21.670808 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2dc50e6d-4105-474a-88a2-3f2812d0ce35 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:21.672019 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2dc50e6d-4105-474a-88a2-3f2812d0ce35 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:21.679529 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2dc50e6d-4105-474a-88a2-3f2812d0ce35 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:21.680010 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2dc50e6d-4105-474a-88a2-3f2812d0ce35 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:21.680815 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2dc50e6d-4105-474a-88a2-3f2812d0ce35 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:21.681250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2dc50e6d-4105-474a-88a2-3f2812d0ce35 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:21.716081 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2dc50e6d-4105-474a-88a2-3f2812d0ce35 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050084 Jun 03 13:30:21.716790 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 475/891] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:30:21 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:22.105971 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ccf1ff30-031a-4533-a739-0a886be2c501 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:22.107161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ccf1ff30-031a-4533-a739-0a886be2c501 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:22.114293 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ccf1ff30-031a-4533-a739-0a886be2c501 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:22.115016 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ccf1ff30-031a-4533-a739-0a886be2c501 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:22.116460 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ccf1ff30-031a-4533-a739-0a886be2c501 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:22.117109 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ccf1ff30-031a-4533-a739-0a886be2c501 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:22.261401 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-ccf1ff30-031a-4533-a739-0a886be2c501 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:22.270212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ccf1ff30-031a-4533-a739-0a886be2c501 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1313 microversion: 2.1 time: 0.168179 Jun 03 13:30:22.270779 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 417/892] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:22 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:22.541891 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3fabef1a-2352-48d7-b14b-7ebd09c16434 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:22.542517 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3fabef1a-2352-48d7-b14b-7ebd09c16434 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:22.549080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3fabef1a-2352-48d7-b14b-7ebd09c16434 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:22.549543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3fabef1a-2352-48d7-b14b-7ebd09c16434 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:22.550501 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3fabef1a-2352-48d7-b14b-7ebd09c16434 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:22.550946 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3fabef1a-2352-48d7-b14b-7ebd09c16434 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:22.685814 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3fabef1a-2352-48d7-b14b-7ebd09c16434 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:22.694373 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3fabef1a-2352-48d7-b14b-7ebd09c16434 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:22.695872 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3fabef1a-2352-48d7-b14b-7ebd09c16434 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:22.697045 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3fabef1a-2352-48d7-b14b-7ebd09c16434 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1741 microversion: 2.20 time: 0.159047 Jun 03 13:30:22.697595 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 476/893] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:22 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:22.727009 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dfd3bd19-9b9d-4ac6-b30e-65516fd81461 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:22.728069 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dfd3bd19-9b9d-4ac6-b30e-65516fd81461 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:22.734231 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfd3bd19-9b9d-4ac6-b30e-65516fd81461 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:22.734684 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfd3bd19-9b9d-4ac6-b30e-65516fd81461 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:22.735454 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfd3bd19-9b9d-4ac6-b30e-65516fd81461 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:22.735886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dfd3bd19-9b9d-4ac6-b30e-65516fd81461 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:22.766643 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dfd3bd19-9b9d-4ac6-b30e-65516fd81461 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043485 Jun 03 13:30:22.767129 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 418/894] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:30:22 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:23.287337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-912414ec-9016-4142-a972-1fbfb4521985 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:23.288072 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-912414ec-9016-4142-a972-1fbfb4521985 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:23.294171 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-912414ec-9016-4142-a972-1fbfb4521985 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:23.294629 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-912414ec-9016-4142-a972-1fbfb4521985 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:23.295521 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-912414ec-9016-4142-a972-1fbfb4521985 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:23.295902 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-912414ec-9016-4142-a972-1fbfb4521985 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:23.432764 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-912414ec-9016-4142-a972-1fbfb4521985 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:23.440313 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-912414ec-9016-4142-a972-1fbfb4521985 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1497 microversion: 2.1 time: 0.157392 Jun 03 13:30:23.440906 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 477/895] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:23 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:23.715430 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-84a60cc7-a65c-4c02-8257-e236bc41ccb8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:23.716040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-84a60cc7-a65c-4c02-8257-e236bc41ccb8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:23.723583 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-84a60cc7-a65c-4c02-8257-e236bc41ccb8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:23.724040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-84a60cc7-a65c-4c02-8257-e236bc41ccb8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:23.724832 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-84a60cc7-a65c-4c02-8257-e236bc41ccb8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:23.725268 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-84a60cc7-a65c-4c02-8257-e236bc41ccb8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:23.778841 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d6237567-4287-429d-bfd9-c54d7b725a8b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:23.780359 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d6237567-4287-429d-bfd9-c54d7b725a8b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:23.788913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6237567-4287-429d-bfd9-c54d7b725a8b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:23.789611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6237567-4287-429d-bfd9-c54d7b725a8b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:23.790386 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6237567-4287-429d-bfd9-c54d7b725a8b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:23.790831 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6237567-4287-429d-bfd9-c54d7b725a8b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:23.821921 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d6237567-4287-429d-bfd9-c54d7b725a8b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047168 Jun 03 13:30:23.822495 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 478/896] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:30:23 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:30:23.862966 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-84a60cc7-a65c-4c02-8257-e236bc41ccb8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:23.871327 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-84a60cc7-a65c-4c02-8257-e236bc41ccb8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:23.872867 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-84a60cc7-a65c-4c02-8257-e236bc41ccb8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:23.874033 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-84a60cc7-a65c-4c02-8257-e236bc41ccb8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1741 microversion: 2.20 time: 0.162644 Jun 03 13:30:23.874598 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 419/897] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:23 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:24.542268 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-843ac7d0-b2fe-4bff-b3a1-18c380afff6f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:24.542784 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-843ac7d0-b2fe-4bff-b3a1-18c380afff6f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:24.550137 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-843ac7d0-b2fe-4bff-b3a1-18c380afff6f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:24.552041 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-843ac7d0-b2fe-4bff-b3a1-18c380afff6f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:24.553004 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-843ac7d0-b2fe-4bff-b3a1-18c380afff6f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:24.553599 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-843ac7d0-b2fe-4bff-b3a1-18c380afff6f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:24.579393 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-843ac7d0-b2fe-4bff-b3a1-18c380afff6f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Going to try to terminate instance {{(pid=118179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:30:24.833267 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-5a949b61-92c4-4868-a229-738180390673 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:24.834236 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-5a949b61-92c4-4868-a229-738180390673 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:24.840953 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5a949b61-92c4-4868-a229-738180390673 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:24.841398 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5a949b61-92c4-4868-a229-738180390673 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:24.842361 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5a949b61-92c4-4868-a229-738180390673 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:24.842798 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5a949b61-92c4-4868-a229-738180390673 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:24.887858 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-5a949b61-92c4-4868-a229-738180390673 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058713 Jun 03 13:30:24.888490 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 420/898] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:30:24 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 03 13:30:24.894061 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3dc89215-aa49-4d6b-9381-d2eabcd712de tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:24.894750 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3dc89215-aa49-4d6b-9381-d2eabcd712de tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:24.901031 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3dc89215-aa49-4d6b-9381-d2eabcd712de tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:24.901487 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3dc89215-aa49-4d6b-9381-d2eabcd712de tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:24.902260 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3dc89215-aa49-4d6b-9381-d2eabcd712de tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:24.902702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3dc89215-aa49-4d6b-9381-d2eabcd712de tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:25.107318 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3dc89215-aa49-4d6b-9381-d2eabcd712de tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:25.115780 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3dc89215-aa49-4d6b-9381-d2eabcd712de tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:25.117322 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3dc89215-aa49-4d6b-9381-d2eabcd712de tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:25.118500 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3dc89215-aa49-4d6b-9381-d2eabcd712de tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1723 microversion: 2.20 time: 0.229091 Jun 03 13:30:25.119059 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 421/899] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:24 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:25.123896 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-162c8fa0-7c13-4347-95b5-0b9315aedef3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:25.124587 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-162c8fa0-7c13-4347-95b5-0b9315aedef3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:25.131289 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-162c8fa0-7c13-4347-95b5-0b9315aedef3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:25.131738 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-162c8fa0-7c13-4347-95b5-0b9315aedef3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:25.132537 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-162c8fa0-7c13-4347-95b5-0b9315aedef3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:25.132972 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-162c8fa0-7c13-4347-95b5-0b9315aedef3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:25.158561 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-162c8fa0-7c13-4347-95b5-0b9315aedef3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Going to try to terminate instance {{(pid=118178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:30:25.193841 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-843ac7d0-b2fe-4bff-b3a1-18c380afff6f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "DELETE /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 204 len: 0 microversion: 2.1 time: 0.655365 Jun 03 13:30:25.194528 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 479/900] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:30:24 2022] DELETE /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:30:25.203096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-19ea0c5a-2a22-4f87-b786-3553f4f1056c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:25.206202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-19ea0c5a-2a22-4f87-b786-3553f4f1056c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:25.211529 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-19ea0c5a-2a22-4f87-b786-3553f4f1056c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:25.211988 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-19ea0c5a-2a22-4f87-b786-3553f4f1056c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:25.212786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-19ea0c5a-2a22-4f87-b786-3553f4f1056c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:25.213225 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-19ea0c5a-2a22-4f87-b786-3553f4f1056c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:25.353843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-19ea0c5a-2a22-4f87-b786-3553f4f1056c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:25.361240 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-19ea0c5a-2a22-4f87-b786-3553f4f1056c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1503 microversion: 2.1 time: 0.162393 Jun 03 13:30:25.361813 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 480/901] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:25 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:25.531941 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-162c8fa0-7c13-4347-95b5-0b9315aedef3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 204 len: 0 microversion: 2.1 time: 0.411476 Jun 03 13:30:25.532568 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 422/902] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:30:25 2022] DELETE /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:30:25.541110 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e6f6903b-4ec0-4be5-8dd8-0ead29319e36 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:25.541721 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e6f6903b-4ec0-4be5-8dd8-0ead29319e36 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:25.548050 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6f6903b-4ec0-4be5-8dd8-0ead29319e36 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:25.548544 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6f6903b-4ec0-4be5-8dd8-0ead29319e36 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:25.549302 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6f6903b-4ec0-4be5-8dd8-0ead29319e36 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:25.549739 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6f6903b-4ec0-4be5-8dd8-0ead29319e36 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:25.680422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e6f6903b-4ec0-4be5-8dd8-0ead29319e36 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:25.687812 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e6f6903b-4ec0-4be5-8dd8-0ead29319e36 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1680 microversion: 2.1 time: 0.150437 Jun 03 13:30:25.688408 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 481/903] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:25 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:26.138263 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9101e36e-9d6a-49b5-b07b-9088f4e81001 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:26.138954 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-9101e36e-9d6a-49b5-b07b-9088f4e81001 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:26.145649 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9101e36e-9d6a-49b5-b07b-9088f4e81001 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:26.146101 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9101e36e-9d6a-49b5-b07b-9088f4e81001 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:26.146866 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9101e36e-9d6a-49b5-b07b-9088f4e81001 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:26.147305 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9101e36e-9d6a-49b5-b07b-9088f4e81001 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:26.276309 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9101e36e-9d6a-49b5-b07b-9088f4e81001 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:26.284184 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9101e36e-9d6a-49b5-b07b-9088f4e81001 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:26.286872 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9101e36e-9d6a-49b5-b07b-9088f4e81001 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:26.288037 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9101e36e-9d6a-49b5-b07b-9088f4e81001 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1723 microversion: 2.20 time: 0.154099 Jun 03 13:30:26.288632 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 423/904] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:26 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:26.380403 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ed140185-03e6-4925-a1cf-0d0d65db334c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:26.381098 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ed140185-03e6-4925-a1cf-0d0d65db334c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:26.387713 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ed140185-03e6-4925-a1cf-0d0d65db334c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:26.388227 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ed140185-03e6-4925-a1cf-0d0d65db334c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:26.389076 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ed140185-03e6-4925-a1cf-0d0d65db334c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:26.389564 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ed140185-03e6-4925-a1cf-0d0d65db334c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:26.521466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ed140185-03e6-4925-a1cf-0d0d65db334c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:26.528331 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:26.529440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ed140185-03e6-4925-a1cf-0d0d65db334c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1503 microversion: 2.1 time: 0.154568 Jun 03 13:30:26.530011 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 482/905] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:26 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:26.705847 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-27648dec-7955-4426-b1bd-3f6f7dcd528c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:26.706461 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-27648dec-7955-4426-b1bd-3f6f7dcd528c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:26.715245 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-27648dec-7955-4426-b1bd-3f6f7dcd528c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:26.715698 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-27648dec-7955-4426-b1bd-3f6f7dcd528c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:26.717772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-27648dec-7955-4426-b1bd-3f6f7dcd528c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:26.717772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-27648dec-7955-4426-b1bd-3f6f7dcd528c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:26.866577 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-27648dec-7955-4426-b1bd-3f6f7dcd528c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:26.870140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:26.874498 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-27648dec-7955-4426-b1bd-3f6f7dcd528c tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1680 microversion: 2.1 time: 0.172601 Jun 03 13:30:26.875075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 424/906] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:26 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:27.306595 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c24753f7-b6d4-4e4e-b824-a34245d74aaa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:27.307199 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c24753f7-b6d4-4e4e-b824-a34245d74aaa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:27.313618 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c24753f7-b6d4-4e4e-b824-a34245d74aaa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:27.314062 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c24753f7-b6d4-4e4e-b824-a34245d74aaa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:27.314814 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c24753f7-b6d4-4e4e-b824-a34245d74aaa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:27.315244 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c24753f7-b6d4-4e4e-b824-a34245d74aaa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:27.447988 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c24753f7-b6d4-4e4e-b824-a34245d74aaa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:27.455990 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c24753f7-b6d4-4e4e-b824-a34245d74aaa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:27.458355 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c24753f7-b6d4-4e4e-b824-a34245d74aaa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:27.459520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c24753f7-b6d4-4e4e-b824-a34245d74aaa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1723 microversion: 2.20 time: 0.157194 Jun 03 13:30:27.460082 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 483/907] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:27 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:27.546961 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9eebe5eb-3763-4904-95db-f08c9b0a1500 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:27.547565 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-9eebe5eb-3763-4904-95db-f08c9b0a1500 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:27.554837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9eebe5eb-3763-4904-95db-f08c9b0a1500 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:27.555280 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9eebe5eb-3763-4904-95db-f08c9b0a1500 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:27.556029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9eebe5eb-3763-4904-95db-f08c9b0a1500 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:27.556488 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9eebe5eb-3763-4904-95db-f08c9b0a1500 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:27.686433 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9eebe5eb-3763-4904-95db-f08c9b0a1500 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:27.693971 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9eebe5eb-3763-4904-95db-f08c9b0a1500 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1503 microversion: 2.1 time: 0.150724 Jun 03 13:30:27.694722 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 425/908] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:27 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:27.892574 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8b8c80ab-87c1-4899-92f7-4e523cbaac2d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:27.893182 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8b8c80ab-87c1-4899-92f7-4e523cbaac2d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:27.900051 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8b8c80ab-87c1-4899-92f7-4e523cbaac2d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:27.900537 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8b8c80ab-87c1-4899-92f7-4e523cbaac2d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:27.901793 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8b8c80ab-87c1-4899-92f7-4e523cbaac2d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:27.902232 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8b8c80ab-87c1-4899-92f7-4e523cbaac2d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:28.028558 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8b8c80ab-87c1-4899-92f7-4e523cbaac2d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:28.035880 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8b8c80ab-87c1-4899-92f7-4e523cbaac2d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1680 microversion: 2.1 time: 0.147249 Jun 03 13:30:28.036584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 484/909] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:27 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:28.333197 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-64d36af3-4bc1-4941-91f7-e503ee433ef1 req-49b09245-93d8-4de4-88f3-363ad1d1df65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f51fd4a-3353-43f3-b528-c767e6b916d8", "name": "network-vif-unplugged", "status": "completed", "tag": "173fe60e-b29a-407d-93fa-37787cf955ce"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:28.341985 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-64d36af3-4bc1-4941-91f7-e503ee433ef1 req-49b09245-93d8-4de4-88f3-363ad1d1df65 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:28.342433 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-64d36af3-4bc1-4941-91f7-e503ee433ef1 req-49b09245-93d8-4de4-88f3-363ad1d1df65 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:28.353253 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-64d36af3-4bc1-4941-91f7-e503ee433ef1 req-49b09245-93d8-4de4-88f3-363ad1d1df65 service nova] Creating event network-vif-unplugged:173fe60e-b29a-407d-93fa-37787cf955ce for instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 on hv-cinder-80135 Jun 03 13:30:28.358118 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-64d36af3-4bc1-4941-91f7-e503ee433ef1 req-49b09245-93d8-4de4-88f3-363ad1d1df65 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028685 Jun 03 13:30:28.358696 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 426/910] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:28.478483 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-15a4e07c-a487-4f4a-b5b5-634821967304 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:28.479023 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-15a4e07c-a487-4f4a-b5b5-634821967304 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:28.486025 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-15a4e07c-a487-4f4a-b5b5-634821967304 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:28.486476 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-15a4e07c-a487-4f4a-b5b5-634821967304 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:28.487229 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-15a4e07c-a487-4f4a-b5b5-634821967304 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:28.487666 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-15a4e07c-a487-4f4a-b5b5-634821967304 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:28.712877 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6943ea0d-5d63-4b59-857b-04da67ce5199 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:28.713800 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6943ea0d-5d63-4b59-857b-04da67ce5199 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:28.721181 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6943ea0d-5d63-4b59-857b-04da67ce5199 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:28.721627 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6943ea0d-5d63-4b59-857b-04da67ce5199 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:28.722400 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6943ea0d-5d63-4b59-857b-04da67ce5199 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:28.722833 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6943ea0d-5d63-4b59-857b-04da67ce5199 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:28.879049 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-15a4e07c-a487-4f4a-b5b5-634821967304 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:28.884321 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6943ea0d-5d63-4b59-857b-04da67ce5199 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:28.891993 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6943ea0d-5d63-4b59-857b-04da67ce5199 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1503 microversion: 2.1 time: 0.184671 Jun 03 13:30:28.892375 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-15a4e07c-a487-4f4a-b5b5-634821967304 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:28.892807 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 427/911] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:28 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:28.893994 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-15a4e07c-a487-4f4a-b5b5-634821967304 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:28.895673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-15a4e07c-a487-4f4a-b5b5-634821967304 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1723 microversion: 2.20 time: 0.421722 Jun 03 13:30:28.897481 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 485/912] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:28 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:29.053326 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-43bf0772-5b72-4afe-8d4d-794ef59c0c34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:29.054238 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-43bf0772-5b72-4afe-8d4d-794ef59c0c34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:29.060635 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-43bf0772-5b72-4afe-8d4d-794ef59c0c34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:29.061297 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-43bf0772-5b72-4afe-8d4d-794ef59c0c34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:29.062140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-43bf0772-5b72-4afe-8d4d-794ef59c0c34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:29.062670 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-43bf0772-5b72-4afe-8d4d-794ef59c0c34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:29.195869 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-43bf0772-5b72-4afe-8d4d-794ef59c0c34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:29.203801 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-43bf0772-5b72-4afe-8d4d-794ef59c0c34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1680 microversion: 2.1 time: 0.154315 Jun 03 13:30:29.204481 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 428/913] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:29 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:29.910956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-67e813a8-358a-43b2-a77a-3893b39ef08d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:29.912250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-67e813a8-358a-43b2-a77a-3893b39ef08d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:29.918524 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-86d29111-00c2-4320-b205-befe075058f6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:29.919156 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-86d29111-00c2-4320-b205-befe075058f6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:29.922330 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67e813a8-358a-43b2-a77a-3893b39ef08d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:29.923779 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67e813a8-358a-43b2-a77a-3893b39ef08d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:29.924966 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67e813a8-358a-43b2-a77a-3893b39ef08d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:29.925478 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67e813a8-358a-43b2-a77a-3893b39ef08d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:29.926421 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-86d29111-00c2-4320-b205-befe075058f6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:29.926870 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-86d29111-00c2-4320-b205-befe075058f6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:29.927644 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-86d29111-00c2-4320-b205-befe075058f6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:29.928077 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-86d29111-00c2-4320-b205-befe075058f6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:30.077665 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-67e813a8-358a-43b2-a77a-3893b39ef08d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:30.088900 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-67e813a8-358a-43b2-a77a-3893b39ef08d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1503 microversion: 2.1 time: 0.181835 Jun 03 13:30:30.092552 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 486/914] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:29 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:30.194120 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-86d29111-00c2-4320-b205-befe075058f6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:30.207343 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-86d29111-00c2-4320-b205-befe075058f6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:30.208311 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-86d29111-00c2-4320-b205-befe075058f6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:30.209616 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-86d29111-00c2-4320-b205-befe075058f6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1723 microversion: 2.20 time: 0.297612 Jun 03 13:30:30.221377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 429/915] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:29 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:30.223795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b90ce4ec-f718-4c18-8c4c-3763b7db7cee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:30.228171 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b90ce4ec-f718-4c18-8c4c-3763b7db7cee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:30.231293 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b90ce4ec-f718-4c18-8c4c-3763b7db7cee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:30.231745 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b90ce4ec-f718-4c18-8c4c-3763b7db7cee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:30.232557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b90ce4ec-f718-4c18-8c4c-3763b7db7cee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:30.233164 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b90ce4ec-f718-4c18-8c4c-3763b7db7cee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:30.391833 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b90ce4ec-f718-4c18-8c4c-3763b7db7cee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:30.404122 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b90ce4ec-f718-4c18-8c4c-3763b7db7cee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1680 microversion: 2.1 time: 0.186226 Jun 03 13:30:30.405097 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 487/916] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:30 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:30.999573 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-f988f228-b546-4839-85ce-f26a8fc485bd req-86e28b0f-f5d3-4b1f-adb9-ed5977320867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db19e740-5ca9-47d0-bacd-e7c89c2eefac", "name": "network-vif-deleted", "tag": "a29c2299-1961-4b3b-9e63-d15fca110d91"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:31.012727 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-f988f228-b546-4839-85ce-f26a8fc485bd req-86e28b0f-f5d3-4b1f-adb9-ed5977320867 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:31.019705 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-f988f228-b546-4839-85ce-f26a8fc485bd req-86e28b0f-f5d3-4b1f-adb9-ed5977320867 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:31.033310 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-f988f228-b546-4839-85ce-f26a8fc485bd req-86e28b0f-f5d3-4b1f-adb9-ed5977320867 service nova] Creating event network-vif-deleted:a29c2299-1961-4b3b-9e63-d15fca110d91 for instance db19e740-5ca9-47d0-bacd-e7c89c2eefac on hv-cinder-80135 Jun 03 13:30:31.039999 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-f988f228-b546-4839-85ce-f26a8fc485bd req-86e28b0f-f5d3-4b1f-adb9-ed5977320867 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046586 Jun 03 13:30:31.040700 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 430/917] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:31.114466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d6e71d2c-3e9e-40a1-9e16-1189792da6dd tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:31.114466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d6e71d2c-3e9e-40a1-9e16-1189792da6dd tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:31.115049 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6e71d2c-3e9e-40a1-9e16-1189792da6dd tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:31.115553 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6e71d2c-3e9e-40a1-9e16-1189792da6dd tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:31.117526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6e71d2c-3e9e-40a1-9e16-1189792da6dd tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:31.118310 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d6e71d2c-3e9e-40a1-9e16-1189792da6dd tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:31.190419 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d6e71d2c-3e9e-40a1-9e16-1189792da6dd tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:31.202404 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d6e71d2c-3e9e-40a1-9e16-1189792da6dd tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 200 len: 1461 microversion: 2.1 time: 0.100313 Jun 03 13:30:31.203245 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 488/918] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:31 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 1461 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:31.230156 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-bfdfa53f-e67c-4ed3-9a8a-8d69f3a6badb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:31.230859 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-bfdfa53f-e67c-4ed3-9a8a-8d69f3a6badb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:31.239411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bfdfa53f-e67c-4ed3-9a8a-8d69f3a6badb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:31.245090 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bfdfa53f-e67c-4ed3-9a8a-8d69f3a6badb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:31.245090 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bfdfa53f-e67c-4ed3-9a8a-8d69f3a6badb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:31.245090 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-bfdfa53f-e67c-4ed3-9a8a-8d69f3a6badb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:31.424760 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5bbeb6c0-3b33-4832-863b-67fe93bfa111 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:31.426215 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5bbeb6c0-3b33-4832-863b-67fe93bfa111 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:31.433468 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5bbeb6c0-3b33-4832-863b-67fe93bfa111 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:31.436766 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5bbeb6c0-3b33-4832-863b-67fe93bfa111 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:31.437586 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5bbeb6c0-3b33-4832-863b-67fe93bfa111 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:31.438202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5bbeb6c0-3b33-4832-863b-67fe93bfa111 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:31.503676 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-bfdfa53f-e67c-4ed3-9a8a-8d69f3a6badb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:31.514682 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-bfdfa53f-e67c-4ed3-9a8a-8d69f3a6badb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:31.516322 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-bfdfa53f-e67c-4ed3-9a8a-8d69f3a6badb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:31.518623 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-bfdfa53f-e67c-4ed3-9a8a-8d69f3a6badb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1666 microversion: 2.20 time: 0.292980 Jun 03 13:30:31.519697 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 431/919] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:31 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1666 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:31.530318 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5bbeb6c0-3b33-4832-863b-67fe93bfa111 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:31.539558 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8e203c49-3740-4fbb-8c8f-f052f1139373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b3fd24a-d078-49ae-b488-227f2d2f0d40"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:31.542390 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5bbeb6c0-3b33-4832-863b-67fe93bfa111 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1614 microversion: 2.1 time: 0.122873 Jun 03 13:30:31.543421 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 489/920] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:31 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1614 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:31.543916 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8e203c49-3740-4fbb-8c8f-f052f1139373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:31.550931 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e203c49-3740-4fbb-8c8f-f052f1139373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:31.551613 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e203c49-3740-4fbb-8c8f-f052f1139373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:31.553416 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e203c49-3740-4fbb-8c8f-f052f1139373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:31.554734 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8e203c49-3740-4fbb-8c8f-f052f1139373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:32.223873 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ffcd55ea-a90f-4e26-a739-cbf2427ab79d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:32.224723 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ffcd55ea-a90f-4e26-a739-cbf2427ab79d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: db19e740-5ca9-47d0-bacd-e7c89c2eefac] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:32.236733 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ffcd55ea-a90f-4e26-a739-cbf2427ab79d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:32.239701 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ffcd55ea-a90f-4e26-a739-cbf2427ab79d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:32.240808 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ffcd55ea-a90f-4e26-a739-cbf2427ab79d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:32.242021 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ffcd55ea-a90f-4e26-a739-cbf2427ab79d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:32.263163 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-ffcd55ea-a90f-4e26-a739-cbf2427ab79d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] HTTP exception thrown: Instance db19e740-5ca9-47d0-bacd-e7c89c2eefac could not be found. Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ffcd55ea-a90f-4e26-a739-cbf2427ab79d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Request method failure captured: Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac HTTP/1.1 Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgzaAcYywM8tZGO8UZKiLOw_iRKM9IUVhcC0I1z8_urOukE-X-K3PMcD7LOqny-NL_YligCSh2sLgsUFkANp3UXlGNj6ZmJYQvEKu_ObOGNEKWlgkqnc35F2Oh8NTehGOboGhQnN_vZOq50Xgfmu0Cmgt7Qme0HXyEE9N7l-gHG0uM4 Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 8db1c45b9113447b8ffc69365cf598bc Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesActionsTest-123373577 Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:30:32.264950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:30:32.266797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8db1c45b9113447b8ffc69365cf598bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8db1c45b9113447b8ffc69365cf598bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8db1c45b9113447b8ffc69365cf598bc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8db1c45b9113447b8ffc69365cf598bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:30:32.266797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesActionsTest-123373577 Jun 03 13:30:32.266797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 8db1c45b9113447b8ffc69365cf598bc Jun 03 13:30:32.266797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesActionsTest-123373577 Jun 03 13:30:32.266797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesActionsTest-123373577-project Jun 03 13:30:32.266797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:30:32.266797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:30:32.266797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 1470975f53c44571be88b20b13d277c2 Jun 03 13:30:32.266797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesActionsTest-123373577-project Jun 03 13:30:32.266797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:30:32.266797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance db19e740-5ca9-47d0-bacd-e7c89c2eefac could not be found. Jun 03 13:30:32.266797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': 'db19e740-5ca9-47d0-bacd-e7c89c2eefac'} Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db19e740-5ca9-47d0-bacd-e7c89c2eefac could not be found. Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:30:32.267807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db19e740-5ca9-47d0-bacd-e7c89c2eefac could not be found. Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db19e740-5ca9-47d0-bacd-e7c89c2eefac could not be found. Jun 03 13:30:32.269575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:30:32.271136 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ffcd55ea-a90f-4e26-a739-cbf2427ab79d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Returning 404 to user: Instance db19e740-5ca9-47d0-bacd-e7c89c2eefac could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:30:32.271136 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ffcd55ea-a90f-4e26-a739-cbf2427ab79d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac" status: 404 len: 111 microversion: 2.1 time: 0.050793 Jun 03 13:30:32.271136 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 490/921] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:32 2022] GET /compute/v2.1/servers/db19e740-5ca9-47d0-bacd-e7c89c2eefac => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:30:32.333141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-288293514", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "networks": [{"uuid": "658d84f7-9c35-43fe-9a55-961269f13341"}]}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:32.403867 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] validate_networks() for [('658d84f7-9c35-43fe-9a55-961269f13341', None, None, None, None, None)] {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:30:32.798842 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8e203c49-3740-4fbb-8c8f-f052f1139373 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "POST /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.264437 Jun 03 13:30:32.804474 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 432/922] 10.222.0.61 () {62 vars in 1363 bytes} [Fri Jun 3 13:30:31 2022] POST /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/os-volume_attachments => generated 188 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:30:32.811211 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4ba15117-0b5b-4c12-bff3-35fd2aee376d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:32.811955 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4ba15117-0b5b-4c12-bff3-35fd2aee376d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:32.830894 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ba15117-0b5b-4c12-bff3-35fd2aee376d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:32.831761 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ba15117-0b5b-4c12-bff3-35fd2aee376d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:32.833154 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ba15117-0b5b-4c12-bff3-35fd2aee376d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:32.834071 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ba15117-0b5b-4c12-bff3-35fd2aee376d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:32.850687 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:30:32.852402 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:30:32.853072 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:30:32.853705 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:30:32.854291 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:30:32.866287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:32.866750 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:32.867543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:32.868339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:32.897240 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Getting quotas for project 8db1c45b9113447b8ffc69365cf598bc. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:30:32.903216 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Getting quotas for user 1470975f53c44571be88b20b13d277c2 and project 8db1c45b9113447b8ffc69365cf598bc. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:30:32.908254 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ba15117-0b5b-4c12-bff3-35fd2aee376d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:32.908988 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ba15117-0b5b-4c12-bff3-35fd2aee376d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:32.909588 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-4ba15117-0b5b-4c12-bff3-35fd2aee376d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lazy-loading 'fault' on Instance uuid a9457ca1-60e7-419b-9c30-10d88085d7ba {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:30:32.918245 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:30:32.921575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:30:32.968296 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4ba15117-0b5b-4c12-bff3-35fd2aee376d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:32.987110 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4ba15117-0b5b-4c12-bff3-35fd2aee376d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 200 len: 1331 microversion: 2.1 time: 0.181466 Jun 03 13:30:32.987820 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 433/923] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:32 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 1331 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:32.995758 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d5dd084d-5ace-4181-b89b-b7b335f7671c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:32.997577 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d5dd084d-5ace-4181-b89b-b7b335f7671c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:33.007662 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d5dd084d-5ace-4181-b89b-b7b335f7671c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:33.007662 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d5dd084d-5ace-4181-b89b-b7b335f7671c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:33.007662 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d5dd084d-5ace-4181-b89b-b7b335f7671c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:33.007662 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d5dd084d-5ace-4181-b89b-b7b335f7671c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:33.087391 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e7de6fa5-f762-4854-b2ef-1484a25fa321 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758167 Jun 03 13:30:33.088408 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 491/924] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:30:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:30:33.093540 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-51b77363-8877-477f-9460-b6dbc967829f req-2d28e256-0fe9-40b6-8810-34e8a0da3fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9457ca1-60e7-419b-9c30-10d88085d7ba", "name": "network-vif-deleted", "tag": "fe3016e6-27d9-4942-8713-38f60a2301b8"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:33.103370 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-51b77363-8877-477f-9460-b6dbc967829f req-2d28e256-0fe9-40b6-8810-34e8a0da3fd1 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:33.103976 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-51b77363-8877-477f-9460-b6dbc967829f req-2d28e256-0fe9-40b6-8810-34e8a0da3fd1 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:33.118285 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-51b77363-8877-477f-9460-b6dbc967829f req-2d28e256-0fe9-40b6-8810-34e8a0da3fd1 service nova] Creating event network-vif-deleted:fe3016e6-27d9-4942-8713-38f60a2301b8 for instance a9457ca1-60e7-419b-9c30-10d88085d7ba on hv-cinder-80135 Jun 03 13:30:33.123834 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-51b77363-8877-477f-9460-b6dbc967829f req-2d28e256-0fe9-40b6-8810-34e8a0da3fd1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034018 Jun 03 13:30:33.124767 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 492/925] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:33.145975 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-4c9095c1-80cc-47a6-beb4-e23df1947e02 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:33.146686 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-4c9095c1-80cc-47a6-beb4-e23df1947e02 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:33.225749 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-4c9095c1-80cc-47a6-beb4-e23df1947e02 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:33.236714 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-4c9095c1-80cc-47a6-beb4-e23df1947e02 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1213 microversion: 2.1 time: 0.094517 Jun 03 13:30:33.237515 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 493/926] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:33 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:33.684355 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d5dd084d-5ace-4181-b89b-b7b335f7671c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/os-volume_attachments/7b3fd24a-d078-49ae-b488-227f2d2f0d40" status: 202 len: 0 microversion: 2.20 time: 0.695126 Jun 03 13:30:33.688288 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 434/927] 10.222.0.61 () {60 vars in 1456 bytes} [Fri Jun 3 13:30:32 2022] DELETE /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/os-volume_attachments/7b3fd24a-d078-49ae-b488-227f2d2f0d40 => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:30:33.750047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-da3c6011-c499-4578-86c1-8ff11668d788 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:33.751818 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-da3c6011-c499-4578-86c1-8ff11668d788 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:33.761836 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-da3c6011-c499-4578-86c1-8ff11668d788 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:33.762406 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-da3c6011-c499-4578-86c1-8ff11668d788 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:33.763277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-da3c6011-c499-4578-86c1-8ff11668d788 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:33.763716 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-da3c6011-c499-4578-86c1-8ff11668d788 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:34.007698 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-da3c6011-c499-4578-86c1-8ff11668d788 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "POST /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/action" status: 202 len: 0 microversion: 2.20 time: 0.261188 Jun 03 13:30:34.008248 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c8f8d08d-4e6b-44af-9b05-462edc4a82be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:34.008950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 494/928] 10.222.0.61 () {62 vars in 1318 bytes} [Fri Jun 3 13:30:33 2022] POST /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:30:34.014069 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-c8f8d08d-4e6b-44af-9b05-462edc4a82be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:34.016799 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ee809e30-c2e1-4314-82c0-dc03dbb1f5c2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:34.017409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ee809e30-c2e1-4314-82c0-dc03dbb1f5c2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:34.023356 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c8f8d08d-4e6b-44af-9b05-462edc4a82be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:34.024321 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c8f8d08d-4e6b-44af-9b05-462edc4a82be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:34.025312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c8f8d08d-4e6b-44af-9b05-462edc4a82be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:34.025601 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ee809e30-c2e1-4314-82c0-dc03dbb1f5c2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:34.025926 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c8f8d08d-4e6b-44af-9b05-462edc4a82be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:34.026398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ee809e30-c2e1-4314-82c0-dc03dbb1f5c2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:34.027383 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ee809e30-c2e1-4314-82c0-dc03dbb1f5c2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:34.028170 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ee809e30-c2e1-4314-82c0-dc03dbb1f5c2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:34.040270 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-c8f8d08d-4e6b-44af-9b05-462edc4a82be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c8f8d08d-4e6b-44af-9b05-462edc4a82be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba HTTP/1.1 Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:30:34.048702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:30:34.050210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:30:34.050210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:30:34.050210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:30:34.050210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:30:34.050210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:30:34.050210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:30:34.050210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:30:34.050210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:30:34.050210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:30:34.050210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:30:34.050210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:30:34.050210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': 'a9457ca1-60e7-419b-9c30-10d88085d7ba'} Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:30:34.051080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:30:34.052530 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:30:34.054403 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c8f8d08d-4e6b-44af-9b05-462edc4a82be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 404 to user: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:30:34.054403 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c8f8d08d-4e6b-44af-9b05-462edc4a82be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 404 len: 111 microversion: 2.1 time: 0.040112 Jun 03 13:30:34.054403 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 435/929] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:34 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:30:34.058603 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-78d47c1a-51fa-4a4f-a47b-7665ed231bdf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '.version_select at 0x7f5bc8330790>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:34.172795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ee809e30-c2e1-4314-82c0-dc03dbb1f5c2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:34.181748 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ee809e30-c2e1-4314-82c0-dc03dbb1f5c2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:34.183254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ee809e30-c2e1-4314-82c0-dc03dbb1f5c2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:34.184821 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ee809e30-c2e1-4314-82c0-dc03dbb1f5c2 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1674 microversion: 2.20 time: 0.171528 Jun 03 13:30:34.185733 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 495/930] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:34 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:34.191799 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-78d47c1a-51fa-4a4f-a47b-7665ed231bdf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864643134" status: 202 len: 0 microversion: 2.1 time: 0.137764 Jun 03 13:30:34.199431 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 436/931] 10.222.0.61 () {58 vars in 1217 bytes} [Fri Jun 3 13:30:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864643134 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:30:34.255304 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-87efc06b-c820-4e3e-945d-7e0f9accad6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:34.256615 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-87efc06b-c820-4e3e-945d-7e0f9accad6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:34.265304 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-87efc06b-c820-4e3e-945d-7e0f9accad6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:34.266082 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-87efc06b-c820-4e3e-945d-7e0f9accad6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:34.267188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-87efc06b-c820-4e3e-945d-7e0f9accad6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:34.267679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-87efc06b-c820-4e3e-945d-7e0f9accad6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:34.346603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-87efc06b-c820-4e3e-945d-7e0f9accad6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:34.358212 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-87efc06b-c820-4e3e-945d-7e0f9accad6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1217 microversion: 2.1 time: 0.107193 Jun 03 13:30:34.364126 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 496/932] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:34 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:35.124807 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7baf17a9-8b1a-4c9f-aaab-bcaa126f1e23 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: .version_select at 0x7f5bc83a15e0>, body: {"keypair": {"name": "tempest-keypair-838016203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhKrS+S90hIuIH5EJHFOXqjbI8NjwCW29xoM5Ot52vi+SspK2MeFn+9jGVUBa2bMIh64nzCDpTbc7ogleAsdUFvPnMqu8RKwGoH6F9UQGRf2p6dxiUNkckmgBWoS/hS4A=="}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:35.141659 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-7baf17a9-8b1a-4c9f-aaab-bcaa126f1e23 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'key_pairs'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:30:35.145778 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-7baf17a9-8b1a-4c9f-aaab-bcaa126f1e23 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for user 267a2b59a70245dfb7ec1b779f7fdd51 and project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'key_pairs'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:30:35.203958 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-74477216-86b7-49f7-95ff-bfd31e899daf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:35.204607 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-74477216-86b7-49f7-95ff-bfd31e899daf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:35.211619 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-74477216-86b7-49f7-95ff-bfd31e899daf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:35.212051 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-74477216-86b7-49f7-95ff-bfd31e899daf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:35.212856 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-74477216-86b7-49f7-95ff-bfd31e899daf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:35.213464 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-74477216-86b7-49f7-95ff-bfd31e899daf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:35.286536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-7baf17a9-8b1a-4c9f-aaab-bcaa126f1e23 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.165718 Jun 03 13:30:35.287286 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 437/933] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 13:30:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:35.364846 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-74477216-86b7-49f7-95ff-bfd31e899daf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:35.378283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c50693ee-5005-4d6d-9f12-b2ea717dc9c6 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:35.379247 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-74477216-86b7-49f7-95ff-bfd31e899daf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:35.379484 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-c50693ee-5005-4d6d-9f12-b2ea717dc9c6 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:35.380881 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-74477216-86b7-49f7-95ff-bfd31e899daf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:35.382368 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-74477216-86b7-49f7-95ff-bfd31e899daf tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1674 microversion: 2.20 time: 0.182137 Jun 03 13:30:35.388999 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 497/934] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:35 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:35.389128 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c50693ee-5005-4d6d-9f12-b2ea717dc9c6 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:35.389440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c50693ee-5005-4d6d-9f12-b2ea717dc9c6 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:35.390220 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c50693ee-5005-4d6d-9f12-b2ea717dc9c6 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:35.393061 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c50693ee-5005-4d6d-9f12-b2ea717dc9c6 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:35.488605 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c50693ee-5005-4d6d-9f12-b2ea717dc9c6 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:35.497455 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c50693ee-5005-4d6d-9f12-b2ea717dc9c6 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1273 microversion: 2.1 time: 0.124863 Jun 03 13:30:35.498244 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 438/935] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:35 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:36.400745 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1e33d98d-f09c-456b-ab10-0e8da4dfe2c5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:36.402119 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-1e33d98d-f09c-456b-ab10-0e8da4dfe2c5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:36.410627 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1e33d98d-f09c-456b-ab10-0e8da4dfe2c5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:36.414276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1e33d98d-f09c-456b-ab10-0e8da4dfe2c5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:36.414276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1e33d98d-f09c-456b-ab10-0e8da4dfe2c5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:36.414276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1e33d98d-f09c-456b-ab10-0e8da4dfe2c5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:36.518263 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-46b54066-d3a6-4e21-94be-04810c213e55 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:36.518878 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-46b54066-d3a6-4e21-94be-04810c213e55 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:36.527771 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46b54066-d3a6-4e21-94be-04810c213e55 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:36.528518 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46b54066-d3a6-4e21-94be-04810c213e55 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:36.529448 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46b54066-d3a6-4e21-94be-04810c213e55 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:36.530229 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-46b54066-d3a6-4e21-94be-04810c213e55 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:36.585455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1e33d98d-f09c-456b-ab10-0e8da4dfe2c5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:36.597652 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1e33d98d-f09c-456b-ab10-0e8da4dfe2c5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:36.599173 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1e33d98d-f09c-456b-ab10-0e8da4dfe2c5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:36.600478 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1e33d98d-f09c-456b-ab10-0e8da4dfe2c5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.204144 Jun 03 13:30:36.601806 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 498/936] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:36 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:36.845048 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-46b54066-d3a6-4e21-94be-04810c213e55 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:36.853628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-46b54066-d3a6-4e21-94be-04810c213e55 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.341081 Jun 03 13:30:36.854217 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 439/937] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:36 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:37.626633 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-320fbb8a-9974-488a-977f-d67accf83330 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:37.627388 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-320fbb8a-9974-488a-977f-d67accf83330 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:37.635018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-320fbb8a-9974-488a-977f-d67accf83330 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:37.635854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-320fbb8a-9974-488a-977f-d67accf83330 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:37.636877 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-320fbb8a-9974-488a-977f-d67accf83330 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:37.637557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-320fbb8a-9974-488a-977f-d67accf83330 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:37.869799 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-320fbb8a-9974-488a-977f-d67accf83330 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:37.872499 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-56189a59-4748-444c-bc0e-164d7ad0a4f3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:37.873677 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-56189a59-4748-444c-bc0e-164d7ad0a4f3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:37.890253 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-320fbb8a-9974-488a-977f-d67accf83330 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:37.892416 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-320fbb8a-9974-488a-977f-d67accf83330 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:37.894062 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-320fbb8a-9974-488a-977f-d67accf83330 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.271478 Jun 03 13:30:37.904706 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 499/938] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:37 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:37.909186 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-56189a59-4748-444c-bc0e-164d7ad0a4f3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:37.909832 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-56189a59-4748-444c-bc0e-164d7ad0a4f3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:37.910818 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-56189a59-4748-444c-bc0e-164d7ad0a4f3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:37.911429 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-56189a59-4748-444c-bc0e-164d7ad0a4f3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:37.916892 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:38.163864 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-56189a59-4748-444c-bc0e-164d7ad0a4f3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:38.175096 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-56189a59-4748-444c-bc0e-164d7ad0a4f3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.307611 Jun 03 13:30:38.183725 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 440/939] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:37 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:38.233409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-aeff7b4b-fa57-4ddc-9605-e0bc912f3f89 req-034f9956-3f71-4f0c-8aa3-b8d75d62eaed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1becd265-d1f3-43ec-8942-19241f1e3430", "tag": "4d677ea9-f6d0-42a2-9591-d5a1d8554ed8"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:38.254091 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-aeff7b4b-fa57-4ddc-9605-e0bc912f3f89 req-034f9956-3f71-4f0c-8aa3-b8d75d62eaed service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:38.254534 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-aeff7b4b-fa57-4ddc-9605-e0bc912f3f89 req-034f9956-3f71-4f0c-8aa3-b8d75d62eaed service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:38.269587 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-aeff7b4b-fa57-4ddc-9605-e0bc912f3f89 req-034f9956-3f71-4f0c-8aa3-b8d75d62eaed service nova] Creating event network-changed:4d677ea9-f6d0-42a2-9591-d5a1d8554ed8 for instance 1becd265-d1f3-43ec-8942-19241f1e3430 on hv-cinder-80135 Jun 03 13:30:38.275884 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-aeff7b4b-fa57-4ddc-9605-e0bc912f3f89 req-034f9956-3f71-4f0c-8aa3-b8d75d62eaed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046080 Jun 03 13:30:38.279661 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 500/940] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:38.749264 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-428171009", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "933d7ba3-7582-451a-82dc-0b343d5ac36c"}], "security_groups": [{"name": "tempest-securitygroup--648886310"}], "key_name": "tempest-keypair-838016203", "user_data": "}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:38.904442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.network.neutron [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] validate_networks() for [('933d7ba3-7582-451a-82dc-0b343d5ac36c', None, None, None, None, None)] {{(pid=118178) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:30:38.913386 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7a4aa9e8-87bc-4862-9913-542d9ff318a3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:38.914819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7a4aa9e8-87bc-4862-9913-542d9ff318a3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:38.916987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:38.922276 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7a4aa9e8-87bc-4862-9913-542d9ff318a3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:38.922942 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7a4aa9e8-87bc-4862-9913-542d9ff318a3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:38.923901 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7a4aa9e8-87bc-4862-9913-542d9ff318a3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:38.924535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7a4aa9e8-87bc-4862-9913-542d9ff318a3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:39.222243 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7a4aa9e8-87bc-4862-9913-542d9ff318a3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:39.231338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7a4aa9e8-87bc-4862-9913-542d9ff318a3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:39.232879 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7a4aa9e8-87bc-4862-9913-542d9ff318a3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:39.234177 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7a4aa9e8-87bc-4862-9913-542d9ff318a3 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.325396 Jun 03 13:30:39.235084 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 501/941] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:38 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:39.239685 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2cf0d037-d2b6-4d64-87fe-7a0956f8dfa9 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:39.240316 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2cf0d037-d2b6-4d64-87fe-7a0956f8dfa9 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:39.247874 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2cf0d037-d2b6-4d64-87fe-7a0956f8dfa9 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:39.248356 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2cf0d037-d2b6-4d64-87fe-7a0956f8dfa9 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:39.249126 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2cf0d037-d2b6-4d64-87fe-7a0956f8dfa9 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:39.249560 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2cf0d037-d2b6-4d64-87fe-7a0956f8dfa9 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:39.255528 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:39.407956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2cf0d037-d2b6-4d64-87fe-7a0956f8dfa9 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:39.418835 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2cf0d037-d2b6-4d64-87fe-7a0956f8dfa9 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.182604 Jun 03 13:30:39.419941 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 502/942] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:39 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:39.450865 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Flavor limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:30:39.451283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Image limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:30:39.451747 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Flavor pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:30:39.452386 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Image pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:30:39.452799 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:30:39.461919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:39.462602 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:39.463554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:39.464851 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:39.481944 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:30:39.486129 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Getting quotas for user 267a2b59a70245dfb7ec1b779f7fdd51 and project 8468b823dd4e408c98dc1eb01f3019c7. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:30:39.488528 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:39.498168 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Going to run 1 instances... {{(pid=118178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:30:39.548608 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:30:39.648998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-93f037e4-9bb7-4d0d-bc52-296bf03413e1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.904309 Jun 03 13:30:39.649572 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 441/943] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:30:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:30:39.659869 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-13e47e80-1706-45cc-aad6-3d13e2652b40 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:39.660673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-13e47e80-1706-45cc-aad6-3d13e2652b40 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:39.730174 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-13e47e80-1706-45cc-aad6-3d13e2652b40 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:39.737633 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-13e47e80-1706-45cc-aad6-3d13e2652b40 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1240 microversion: 2.1 time: 0.081614 Jun 03 13:30:39.738637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 503/944] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:39 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:40.254184 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b7b7bc8d-8331-4a04-8ded-6de479968f91 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:40.256610 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b7b7bc8d-8331-4a04-8ded-6de479968f91 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:40.264732 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b7b7bc8d-8331-4a04-8ded-6de479968f91 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:40.265214 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b7b7bc8d-8331-4a04-8ded-6de479968f91 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:40.265995 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b7b7bc8d-8331-4a04-8ded-6de479968f91 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:40.266434 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b7b7bc8d-8331-4a04-8ded-6de479968f91 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:40.420929 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b7b7bc8d-8331-4a04-8ded-6de479968f91 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:40.429297 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b7b7bc8d-8331-4a04-8ded-6de479968f91 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:40.430757 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b7b7bc8d-8331-4a04-8ded-6de479968f91 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:40.431928 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b7b7bc8d-8331-4a04-8ded-6de479968f91 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.182950 Jun 03 13:30:40.432829 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 442/945] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:40 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:40.441888 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-124e65c2-0af2-4cd1-8a9f-547229ff2fc4 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:40.443358 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-124e65c2-0af2-4cd1-8a9f-547229ff2fc4 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:40.450782 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-124e65c2-0af2-4cd1-8a9f-547229ff2fc4 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:40.451241 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-124e65c2-0af2-4cd1-8a9f-547229ff2fc4 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:40.452014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-124e65c2-0af2-4cd1-8a9f-547229ff2fc4 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:40.452521 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-124e65c2-0af2-4cd1-8a9f-547229ff2fc4 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:40.600995 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-124e65c2-0af2-4cd1-8a9f-547229ff2fc4 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:40.608416 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-124e65c2-0af2-4cd1-8a9f-547229ff2fc4 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.170703 Jun 03 13:30:40.608980 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 504/946] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:40 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:40.755304 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-046e8256-2d3f-4587-952c-5e74cbb7aef0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:40.755915 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-046e8256-2d3f-4587-952c-5e74cbb7aef0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:40.762620 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-046e8256-2d3f-4587-952c-5e74cbb7aef0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:40.763074 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-046e8256-2d3f-4587-952c-5e74cbb7aef0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:40.763840 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-046e8256-2d3f-4587-952c-5e74cbb7aef0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:40.764312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-046e8256-2d3f-4587-952c-5e74cbb7aef0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:40.831633 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-046e8256-2d3f-4587-952c-5e74cbb7aef0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:40.840700 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-046e8256-2d3f-4587-952c-5e74cbb7aef0 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.089374 Jun 03 13:30:40.841354 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 443/947] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:40 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:41.451315 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d875c1e0-e4da-46ce-92b4-1369a246baf0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:41.451933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d875c1e0-e4da-46ce-92b4-1369a246baf0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:41.459090 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d875c1e0-e4da-46ce-92b4-1369a246baf0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:41.459593 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d875c1e0-e4da-46ce-92b4-1369a246baf0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:41.460812 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d875c1e0-e4da-46ce-92b4-1369a246baf0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:41.461253 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d875c1e0-e4da-46ce-92b4-1369a246baf0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:41.592246 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d875c1e0-e4da-46ce-92b4-1369a246baf0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:41.615190 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d875c1e0-e4da-46ce-92b4-1369a246baf0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:41.616918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d875c1e0-e4da-46ce-92b4-1369a246baf0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:41.618106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d875c1e0-e4da-46ce-92b4-1369a246baf0 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.171053 Jun 03 13:30:41.618674 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 505/948] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:41 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:41.626039 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f9c7e469-01cf-4189-a9df-d3e3d984cf64 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:41.627524 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f9c7e469-01cf-4189-a9df-d3e3d984cf64 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:41.635842 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9c7e469-01cf-4189-a9df-d3e3d984cf64 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:41.636320 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9c7e469-01cf-4189-a9df-d3e3d984cf64 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:41.637100 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9c7e469-01cf-4189-a9df-d3e3d984cf64 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:41.637567 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9c7e469-01cf-4189-a9df-d3e3d984cf64 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:41.771997 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f9c7e469-01cf-4189-a9df-d3e3d984cf64 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:41.780471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f9c7e469-01cf-4189-a9df-d3e3d984cf64 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.158884 Jun 03 13:30:41.781042 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 444/949] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:41 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:41.858101 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-aede7115-0fb5-4c38-a896-85c1019726b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:41.858793 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-aede7115-0fb5-4c38-a896-85c1019726b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:41.865568 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aede7115-0fb5-4c38-a896-85c1019726b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:41.866021 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aede7115-0fb5-4c38-a896-85c1019726b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:41.866846 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aede7115-0fb5-4c38-a896-85c1019726b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:41.867327 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aede7115-0fb5-4c38-a896-85c1019726b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:41.941901 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-aede7115-0fb5-4c38-a896-85c1019726b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:41.950453 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-aede7115-0fb5-4c38-a896-85c1019726b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.096584 Jun 03 13:30:41.951023 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 506/950] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:41 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:42.638740 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e03e7ff1-5950-49e4-9f4c-7cebc4ddad04 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:42.639478 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e03e7ff1-5950-49e4-9f4c-7cebc4ddad04 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:42.646353 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e03e7ff1-5950-49e4-9f4c-7cebc4ddad04 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:42.646797 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e03e7ff1-5950-49e4-9f4c-7cebc4ddad04 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:42.647967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e03e7ff1-5950-49e4-9f4c-7cebc4ddad04 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:42.648522 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e03e7ff1-5950-49e4-9f4c-7cebc4ddad04 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:42.780925 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e03e7ff1-5950-49e4-9f4c-7cebc4ddad04 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:42.798701 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ac0dc96c-32ff-4a3f-a312-503bdeb43e93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:42.799344 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ac0dc96c-32ff-4a3f-a312-503bdeb43e93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:42.801164 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e03e7ff1-5950-49e4-9f4c-7cebc4ddad04 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:42.802721 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e03e7ff1-5950-49e4-9f4c-7cebc4ddad04 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:42.804593 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e03e7ff1-5950-49e4-9f4c-7cebc4ddad04 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.169225 Jun 03 13:30:42.805494 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 445/951] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:42 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:42.808692 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac0dc96c-32ff-4a3f-a312-503bdeb43e93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:42.809315 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac0dc96c-32ff-4a3f-a312-503bdeb43e93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:42.810133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac0dc96c-32ff-4a3f-a312-503bdeb43e93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:42.810544 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ac0dc96c-32ff-4a3f-a312-503bdeb43e93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:42.881135 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:42.960011 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ac0dc96c-32ff-4a3f-a312-503bdeb43e93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:42.968355 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ac0dc96c-32ff-4a3f-a312-503bdeb43e93 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.174049 Jun 03 13:30:42.969853 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f9ca21f1-751a-4c05-a93b-b16338601eb8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:42.970830 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f9ca21f1-751a-4c05-a93b-b16338601eb8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:42.978462 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 507/952] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:42 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:42.979935 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9ca21f1-751a-4c05-a93b-b16338601eb8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:42.980679 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9ca21f1-751a-4c05-a93b-b16338601eb8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:42.982144 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9ca21f1-751a-4c05-a93b-b16338601eb8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:42.982624 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9ca21f1-751a-4c05-a93b-b16338601eb8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:43.053497 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f9ca21f1-751a-4c05-a93b-b16338601eb8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:43.061402 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f9ca21f1-751a-4c05-a93b-b16338601eb8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.096944 Jun 03 13:30:43.061966 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 446/953] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:42 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:43.823602 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6db2d9d1-d8bb-428c-979c-3886704fbb7f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:43.824218 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6db2d9d1-d8bb-428c-979c-3886704fbb7f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:43.830670 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6db2d9d1-d8bb-428c-979c-3886704fbb7f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:43.831123 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6db2d9d1-d8bb-428c-979c-3886704fbb7f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:43.831907 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6db2d9d1-d8bb-428c-979c-3886704fbb7f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:43.832377 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6db2d9d1-d8bb-428c-979c-3886704fbb7f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:43.986349 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4f0d5508-028e-4402-a86b-beff32aca5ac tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:43.986970 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4f0d5508-028e-4402-a86b-beff32aca5ac tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:43.994524 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6db2d9d1-d8bb-428c-979c-3886704fbb7f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:43.994666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4f0d5508-028e-4402-a86b-beff32aca5ac tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:43.995097 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4f0d5508-028e-4402-a86b-beff32aca5ac tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:43.995876 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4f0d5508-028e-4402-a86b-beff32aca5ac tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:43.996348 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4f0d5508-028e-4402-a86b-beff32aca5ac tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:44.003464 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6db2d9d1-d8bb-428c-979c-3886704fbb7f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:44.005393 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-6db2d9d1-d8bb-428c-979c-3886704fbb7f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:44.006575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6db2d9d1-d8bb-428c-979c-3886704fbb7f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.187771 Jun 03 13:30:44.007788 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 508/954] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:43 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:44.078335 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c50f6a66-3f5d-414d-8f75-e7934e438f78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:44.078948 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c50f6a66-3f5d-414d-8f75-e7934e438f78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:44.085548 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c50f6a66-3f5d-414d-8f75-e7934e438f78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:44.086005 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c50f6a66-3f5d-414d-8f75-e7934e438f78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:44.086758 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c50f6a66-3f5d-414d-8f75-e7934e438f78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:44.087190 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c50f6a66-3f5d-414d-8f75-e7934e438f78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:44.136882 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4f0d5508-028e-4402-a86b-beff32aca5ac tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:44.161085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4f0d5508-028e-4402-a86b-beff32aca5ac tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.178995 Jun 03 13:30:44.161857 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c50f6a66-3f5d-414d-8f75-e7934e438f78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:44.165368 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 447/955] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:43 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:44.178239 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c50f6a66-3f5d-414d-8f75-e7934e438f78 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.103702 Jun 03 13:30:44.179055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 509/956] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:44 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:44.331110 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-932aa3b0-445c-4970-beb2-092f53fe3d38 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:44.331522 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-932aa3b0-445c-4970-beb2-092f53fe3d38 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:44.338481 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-932aa3b0-445c-4970-beb2-092f53fe3d38 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:44.338963 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-932aa3b0-445c-4970-beb2-092f53fe3d38 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:44.339734 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-932aa3b0-445c-4970-beb2-092f53fe3d38 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:44.340211 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-932aa3b0-445c-4970-beb2-092f53fe3d38 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:44.362857 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-932aa3b0-445c-4970-beb2-092f53fe3d38 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/ips" status: 200 len: 144 microversion: 2.1 time: 0.035763 Jun 03 13:30:44.363466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 448/957] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 13:30:44 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:45.025371 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-07df5163-59b3-42f9-a5f3-94b321bf2eb6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:45.026071 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-07df5163-59b3-42f9-a5f3-94b321bf2eb6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:45.033081 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-07df5163-59b3-42f9-a5f3-94b321bf2eb6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:45.033583 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-07df5163-59b3-42f9-a5f3-94b321bf2eb6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:45.034423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-07df5163-59b3-42f9-a5f3-94b321bf2eb6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:45.035079 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-07df5163-59b3-42f9-a5f3-94b321bf2eb6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:45.179894 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b18852fe-7331-43b7-81f2-914231efaaea tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:45.181467 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b18852fe-7331-43b7-81f2-914231efaaea tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:45.194013 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b18852fe-7331-43b7-81f2-914231efaaea tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:45.197139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b18852fe-7331-43b7-81f2-914231efaaea tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:45.200529 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b18852fe-7331-43b7-81f2-914231efaaea tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:45.201269 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b18852fe-7331-43b7-81f2-914231efaaea tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:45.219037 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-07df5163-59b3-42f9-a5f3-94b321bf2eb6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:45.231907 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-07df5163-59b3-42f9-a5f3-94b321bf2eb6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:45.233978 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-07df5163-59b3-42f9-a5f3-94b321bf2eb6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:45.237496 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-07df5163-59b3-42f9-a5f3-94b321bf2eb6 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.216155 Jun 03 13:30:45.238288 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 510/958] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:45 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:45.246139 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1dc267a5-23a5-4cff-a737-6673e5d64c22 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:45.247056 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-1dc267a5-23a5-4cff-a737-6673e5d64c22 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:45.253695 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1dc267a5-23a5-4cff-a737-6673e5d64c22 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:45.254611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1dc267a5-23a5-4cff-a737-6673e5d64c22 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:45.255049 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1dc267a5-23a5-4cff-a737-6673e5d64c22 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:45.255492 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1dc267a5-23a5-4cff-a737-6673e5d64c22 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:45.317739 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1dc267a5-23a5-4cff-a737-6673e5d64c22 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:45.340251 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1dc267a5-23a5-4cff-a737-6673e5d64c22 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.099013 Jun 03 13:30:45.340841 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 511/959] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:45 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:45.351451 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b18852fe-7331-43b7-81f2-914231efaaea tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:45.361215 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b18852fe-7331-43b7-81f2-914231efaaea tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.186908 Jun 03 13:30:45.361890 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 449/960] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:45 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:46.258074 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b490f0e8-c6ae-42a0-8e43-bef5da8240c8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:46.258074 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b490f0e8-c6ae-42a0-8e43-bef5da8240c8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:46.264597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b490f0e8-c6ae-42a0-8e43-bef5da8240c8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:46.265051 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b490f0e8-c6ae-42a0-8e43-bef5da8240c8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:46.265815 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b490f0e8-c6ae-42a0-8e43-bef5da8240c8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:46.266254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b490f0e8-c6ae-42a0-8e43-bef5da8240c8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:46.358349 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6d7a81c7-31c7-42cd-b4af-d96197dcf28d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:46.359213 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6d7a81c7-31c7-42cd-b4af-d96197dcf28d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:46.368318 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6d7a81c7-31c7-42cd-b4af-d96197dcf28d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:46.369113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6d7a81c7-31c7-42cd-b4af-d96197dcf28d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:46.370142 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6d7a81c7-31c7-42cd-b4af-d96197dcf28d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:46.370800 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6d7a81c7-31c7-42cd-b4af-d96197dcf28d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:46.415998 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b490f0e8-c6ae-42a0-8e43-bef5da8240c8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:46.424441 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b490f0e8-c6ae-42a0-8e43-bef5da8240c8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:46.425945 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b490f0e8-c6ae-42a0-8e43-bef5da8240c8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:46.427110 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b490f0e8-c6ae-42a0-8e43-bef5da8240c8 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.173730 Jun 03 13:30:46.427818 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 512/961] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:46 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:46.432497 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-fc043a2c-5e3d-4c93-91d8-67a5f84d751a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:46.433098 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-fc043a2c-5e3d-4c93-91d8-67a5f84d751a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:46.439149 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fc043a2c-5e3d-4c93-91d8-67a5f84d751a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:46.439597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fc043a2c-5e3d-4c93-91d8-67a5f84d751a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:46.440382 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fc043a2c-5e3d-4c93-91d8-67a5f84d751a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:46.440817 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fc043a2c-5e3d-4c93-91d8-67a5f84d751a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:46.448267 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6d7a81c7-31c7-42cd-b4af-d96197dcf28d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:46.455758 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6d7a81c7-31c7-42cd-b4af-d96197dcf28d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.101744 Jun 03 13:30:46.456363 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 450/962] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:46 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:46.578881 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fc043a2c-5e3d-4c93-91d8-67a5f84d751a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:46.587014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-fc043a2c-5e3d-4c93-91d8-67a5f84d751a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.158206 Jun 03 13:30:46.587580 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 513/963] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:46 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:47.014009 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8cff4bce-8656-4d0f-8748-3d444250b278 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "355d39fa-cf37-4705-8c80-907c01500e18"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:47.015258 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8cff4bce-8656-4d0f-8748-3d444250b278 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:47.025423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8cff4bce-8656-4d0f-8748-3d444250b278 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:47.031744 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8cff4bce-8656-4d0f-8748-3d444250b278 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:47.031744 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8cff4bce-8656-4d0f-8748-3d444250b278 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:47.031744 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8cff4bce-8656-4d0f-8748-3d444250b278 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:47.446034 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e97b19cc-52e5-4dab-bfc3-a2965a37ebdb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:47.446823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e97b19cc-52e5-4dab-bfc3-a2965a37ebdb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:47.453914 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e97b19cc-52e5-4dab-bfc3-a2965a37ebdb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:47.454367 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e97b19cc-52e5-4dab-bfc3-a2965a37ebdb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:47.455240 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e97b19cc-52e5-4dab-bfc3-a2965a37ebdb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:47.455769 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e97b19cc-52e5-4dab-bfc3-a2965a37ebdb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:47.597712 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e97b19cc-52e5-4dab-bfc3-a2965a37ebdb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:47.607005 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e97b19cc-52e5-4dab-bfc3-a2965a37ebdb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:47.608457 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e97b19cc-52e5-4dab-bfc3-a2965a37ebdb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:47.620572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e97b19cc-52e5-4dab-bfc3-a2965a37ebdb tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.168124 Jun 03 13:30:47.620572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 514/964] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:47 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:47.620572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-629258f1-ecfd-449f-bad1-71881d9b60f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:47.620572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-629258f1-ecfd-449f-bad1-71881d9b60f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:47.623166 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-629258f1-ecfd-449f-bad1-71881d9b60f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:47.623166 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-629258f1-ecfd-449f-bad1-71881d9b60f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:47.623692 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-629258f1-ecfd-449f-bad1-71881d9b60f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:47.624318 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-629258f1-ecfd-449f-bad1-71881d9b60f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:47.705094 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-629258f1-ecfd-449f-bad1-71881d9b60f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:47.713141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-629258f1-ecfd-449f-bad1-71881d9b60f1 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.101768 Jun 03 13:30:47.713689 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 515/965] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:47 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:47.718033 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9eb43e98-917f-496d-a764-328ad88854de tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:47.726088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9eb43e98-917f-496d-a764-328ad88854de tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:47.726088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9eb43e98-917f-496d-a764-328ad88854de tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:47.726088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9eb43e98-917f-496d-a764-328ad88854de tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:47.726088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9eb43e98-917f-496d-a764-328ad88854de tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:47.726479 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9eb43e98-917f-496d-a764-328ad88854de tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:47.867283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9eb43e98-917f-496d-a764-328ad88854de tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:47.874793 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9eb43e98-917f-496d-a764-328ad88854de tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.160173 Jun 03 13:30:47.877787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 516/966] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:47 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:48.631474 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-56d99e86-6296-4eef-a176-d6fa5624abee tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:48.632836 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-56d99e86-6296-4eef-a176-d6fa5624abee tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:48.639475 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-56d99e86-6296-4eef-a176-d6fa5624abee tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:48.639918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-56d99e86-6296-4eef-a176-d6fa5624abee tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:48.640817 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-56d99e86-6296-4eef-a176-d6fa5624abee tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:48.641258 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-56d99e86-6296-4eef-a176-d6fa5624abee tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:48.771000 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-56d99e86-6296-4eef-a176-d6fa5624abee tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:48.780916 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-56d99e86-6296-4eef-a176-d6fa5624abee tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:48.782484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-56d99e86-6296-4eef-a176-d6fa5624abee tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:48.783795 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-56d99e86-6296-4eef-a176-d6fa5624abee tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.156854 Jun 03 13:30:48.787465 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 517/967] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:48 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:48.793487 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ad8dac21-def5-4a11-9f23-6f1b01924c98 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:48.794192 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ad8dac21-def5-4a11-9f23-6f1b01924c98 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:48.801518 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ad8dac21-def5-4a11-9f23-6f1b01924c98 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:48.801518 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ad8dac21-def5-4a11-9f23-6f1b01924c98 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:48.802333 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ad8dac21-def5-4a11-9f23-6f1b01924c98 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:48.802882 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ad8dac21-def5-4a11-9f23-6f1b01924c98 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:48.871775 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ad8dac21-def5-4a11-9f23-6f1b01924c98 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:48.880060 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ad8dac21-def5-4a11-9f23-6f1b01924c98 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.090916 Jun 03 13:30:48.880671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 518/968] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:48 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:48.899101 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-91f1c552-b861-4cb0-949e-068291244d05 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:48.899101 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-91f1c552-b861-4cb0-949e-068291244d05 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:48.901983 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-91f1c552-b861-4cb0-949e-068291244d05 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:48.902435 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-91f1c552-b861-4cb0-949e-068291244d05 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:48.903287 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-91f1c552-b861-4cb0-949e-068291244d05 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:48.903876 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-91f1c552-b861-4cb0-949e-068291244d05 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:49.042255 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-91f1c552-b861-4cb0-949e-068291244d05 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:49.046311 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:49.050793 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-91f1c552-b861-4cb0-949e-068291244d05 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.159594 Jun 03 13:30:49.051644 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 519/969] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:48 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:49.472827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:49.493517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=10 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:49.809222 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ea2ffb4b-16e2-4279-99e7-7de8d7c618a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:49.810344 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ea2ffb4b-16e2-4279-99e7-7de8d7c618a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:49.816397 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=10 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:49.824969 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ea2ffb4b-16e2-4279-99e7-7de8d7c618a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:49.826455 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ea2ffb4b-16e2-4279-99e7-7de8d7c618a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:49.827066 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ea2ffb4b-16e2-4279-99e7-7de8d7c618a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:49.827826 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ea2ffb4b-16e2-4279-99e7-7de8d7c618a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:49.962373 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ea2ffb4b-16e2-4279-99e7-7de8d7c618a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:49.970226 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ea2ffb4b-16e2-4279-99e7-7de8d7c618a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:49.971737 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ea2ffb4b-16e2-4279-99e7-7de8d7c618a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:49.972923 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ea2ffb4b-16e2-4279-99e7-7de8d7c618a5 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.172812 Jun 03 13:30:49.973494 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 520/970] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:49 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:49.978325 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c459fdae-0676-4571-8888-f1a8861ca8da tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:49.978928 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c459fdae-0676-4571-8888-f1a8861ca8da tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:49.984520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c459fdae-0676-4571-8888-f1a8861ca8da tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:49.984967 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c459fdae-0676-4571-8888-f1a8861ca8da tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:49.985719 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c459fdae-0676-4571-8888-f1a8861ca8da tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:49.986159 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c459fdae-0676-4571-8888-f1a8861ca8da tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:50.055377 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c459fdae-0676-4571-8888-f1a8861ca8da tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:50.063033 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c459fdae-0676-4571-8888-f1a8861ca8da tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.088592 Jun 03 13:30:50.063596 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 521/971] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:49 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:50.068321 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2e3bfba5-8aa2-48d5-b4b5-45791bba307c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:50.068930 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2e3bfba5-8aa2-48d5-b4b5-45791bba307c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:50.075178 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2e3bfba5-8aa2-48d5-b4b5-45791bba307c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:50.075625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2e3bfba5-8aa2-48d5-b4b5-45791bba307c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:50.076411 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2e3bfba5-8aa2-48d5-b4b5-45791bba307c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:50.076854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2e3bfba5-8aa2-48d5-b4b5-45791bba307c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:50.204416 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2e3bfba5-8aa2-48d5-b4b5-45791bba307c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:50.212024 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2e3bfba5-8aa2-48d5-b4b5-45791bba307c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.147439 Jun 03 13:30:50.215847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 522/972] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:50 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:50.990932 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-01dcbfba-c4b5-45bd-8b46-296ad210f48c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:50.991793 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-01dcbfba-c4b5-45bd-8b46-296ad210f48c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:50.998347 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-01dcbfba-c4b5-45bd-8b46-296ad210f48c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:50.998790 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-01dcbfba-c4b5-45bd-8b46-296ad210f48c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:50.999546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-01dcbfba-c4b5-45bd-8b46-296ad210f48c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:50.999986 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-01dcbfba-c4b5-45bd-8b46-296ad210f48c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:51.127993 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-01dcbfba-c4b5-45bd-8b46-296ad210f48c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:51.136556 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-01dcbfba-c4b5-45bd-8b46-296ad210f48c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:51.138064 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-01dcbfba-c4b5-45bd-8b46-296ad210f48c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:51.139225 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-01dcbfba-c4b5-45bd-8b46-296ad210f48c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.152300 Jun 03 13:30:51.139784 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 523/973] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:50 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:51.144073 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d5ece0a1-a888-4306-99c8-f7a7bc15614f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:51.144707 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d5ece0a1-a888-4306-99c8-f7a7bc15614f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:51.150904 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d5ece0a1-a888-4306-99c8-f7a7bc15614f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:51.151355 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d5ece0a1-a888-4306-99c8-f7a7bc15614f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:51.152154 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d5ece0a1-a888-4306-99c8-f7a7bc15614f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:51.152612 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d5ece0a1-a888-4306-99c8-f7a7bc15614f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:51.214756 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d5ece0a1-a888-4306-99c8-f7a7bc15614f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:51.222145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d5ece0a1-a888-4306-99c8-f7a7bc15614f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.081403 Jun 03 13:30:51.222742 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 524/974] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:51 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:51.229152 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0b8a716a-813d-4944-9326-545d84549f95 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:51.229766 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0b8a716a-813d-4944-9326-545d84549f95 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:51.235491 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0b8a716a-813d-4944-9326-545d84549f95 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:51.235943 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0b8a716a-813d-4944-9326-545d84549f95 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:51.236739 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0b8a716a-813d-4944-9326-545d84549f95 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:51.237179 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0b8a716a-813d-4944-9326-545d84549f95 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:51.366500 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0b8a716a-813d-4944-9326-545d84549f95 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:51.374272 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0b8a716a-813d-4944-9326-545d84549f95 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.149128 Jun 03 13:30:51.377542 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 525/975] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:51 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:52.158053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c07c88f0-80f4-468c-9fb3-289fa51badce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:52.158675 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c07c88f0-80f4-468c-9fb3-289fa51badce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:52.165829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c07c88f0-80f4-468c-9fb3-289fa51badce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:52.166275 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c07c88f0-80f4-468c-9fb3-289fa51badce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:52.167026 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c07c88f0-80f4-468c-9fb3-289fa51badce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:52.167461 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c07c88f0-80f4-468c-9fb3-289fa51badce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:52.295932 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c07c88f0-80f4-468c-9fb3-289fa51badce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:52.304162 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c07c88f0-80f4-468c-9fb3-289fa51badce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:52.305734 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c07c88f0-80f4-468c-9fb3-289fa51badce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:52.306941 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c07c88f0-80f4-468c-9fb3-289fa51badce tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.152782 Jun 03 13:30:52.307500 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 526/976] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:52 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:52.311834 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-fe4818c0-1568-437f-86be-a426ad635047 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:52.312468 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-fe4818c0-1568-437f-86be-a426ad635047 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:52.318169 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fe4818c0-1568-437f-86be-a426ad635047 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:52.318620 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fe4818c0-1568-437f-86be-a426ad635047 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:52.319539 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fe4818c0-1568-437f-86be-a426ad635047 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:52.320182 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fe4818c0-1568-437f-86be-a426ad635047 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:52.383936 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fe4818c0-1568-437f-86be-a426ad635047 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:52.391334 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-fe4818c0-1568-437f-86be-a426ad635047 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.082899 Jun 03 13:30:52.391902 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 527/977] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:52 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:52.396267 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c4902b7d-7b52-41f0-ad5e-f6b394dfe920 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:52.396878 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c4902b7d-7b52-41f0-ad5e-f6b394dfe920 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:52.403472 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c4902b7d-7b52-41f0-ad5e-f6b394dfe920 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:52.403929 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c4902b7d-7b52-41f0-ad5e-f6b394dfe920 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:52.404733 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c4902b7d-7b52-41f0-ad5e-f6b394dfe920 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:52.405200 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c4902b7d-7b52-41f0-ad5e-f6b394dfe920 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:52.531950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c4902b7d-7b52-41f0-ad5e-f6b394dfe920 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:52.539531 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c4902b7d-7b52-41f0-ad5e-f6b394dfe920 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.146667 Jun 03 13:30:52.540095 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 528/978] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:52 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:53.325684 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5cbfa3e1-125d-489e-bd88-2413b88ec401 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:53.326346 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5cbfa3e1-125d-489e-bd88-2413b88ec401 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:53.333301 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5cbfa3e1-125d-489e-bd88-2413b88ec401 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:53.333650 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5cbfa3e1-125d-489e-bd88-2413b88ec401 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:53.334422 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5cbfa3e1-125d-489e-bd88-2413b88ec401 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:53.334897 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5cbfa3e1-125d-489e-bd88-2413b88ec401 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:53.465316 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5cbfa3e1-125d-489e-bd88-2413b88ec401 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:53.473156 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5cbfa3e1-125d-489e-bd88-2413b88ec401 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:53.474661 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5cbfa3e1-125d-489e-bd88-2413b88ec401 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:53.476510 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5cbfa3e1-125d-489e-bd88-2413b88ec401 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.155057 Jun 03 13:30:53.477081 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 529/979] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:53 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:53.481403 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f2b9caca-7bfc-4e40-97bf-32146d598694 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:53.482011 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f2b9caca-7bfc-4e40-97bf-32146d598694 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:53.487596 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f2b9caca-7bfc-4e40-97bf-32146d598694 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:53.488049 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f2b9caca-7bfc-4e40-97bf-32146d598694 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:53.488842 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f2b9caca-7bfc-4e40-97bf-32146d598694 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:53.489280 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f2b9caca-7bfc-4e40-97bf-32146d598694 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:53.553435 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f2b9caca-7bfc-4e40-97bf-32146d598694 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:53.560987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f2b9caca-7bfc-4e40-97bf-32146d598694 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.082983 Jun 03 13:30:53.561555 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 530/980] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:53 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:53.565867 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-90c81af7-b4e3-47b3-b9ed-1aaf50a10111 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:53.566469 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-90c81af7-b4e3-47b3-b9ed-1aaf50a10111 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:53.573244 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-90c81af7-b4e3-47b3-b9ed-1aaf50a10111 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:53.573695 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-90c81af7-b4e3-47b3-b9ed-1aaf50a10111 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:53.574451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-90c81af7-b4e3-47b3-b9ed-1aaf50a10111 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:53.574884 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-90c81af7-b4e3-47b3-b9ed-1aaf50a10111 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:53.704390 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-90c81af7-b4e3-47b3-b9ed-1aaf50a10111 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:53.712541 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-90c81af7-b4e3-47b3-b9ed-1aaf50a10111 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.150026 Jun 03 13:30:53.713103 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 531/981] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:53 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:54.494592 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-27594a9a-3004-4f9f-9843-8111f9eb2876 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:54.495261 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-27594a9a-3004-4f9f-9843-8111f9eb2876 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:54.501972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-27594a9a-3004-4f9f-9843-8111f9eb2876 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:54.502409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-27594a9a-3004-4f9f-9843-8111f9eb2876 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:54.503163 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-27594a9a-3004-4f9f-9843-8111f9eb2876 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:54.503595 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-27594a9a-3004-4f9f-9843-8111f9eb2876 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:54.636806 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-27594a9a-3004-4f9f-9843-8111f9eb2876 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:54.650096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-27594a9a-3004-4f9f-9843-8111f9eb2876 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:54.652837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-27594a9a-3004-4f9f-9843-8111f9eb2876 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:54.655731 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-27594a9a-3004-4f9f-9843-8111f9eb2876 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.163730 Jun 03 13:30:54.656556 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 532/982] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:54 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:54.665551 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-886112ed-29a3-45d8-b9c8-c8c38ac799d8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:54.666820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-886112ed-29a3-45d8-b9c8-c8c38ac799d8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:54.676138 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-886112ed-29a3-45d8-b9c8-c8c38ac799d8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:54.676955 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-886112ed-29a3-45d8-b9c8-c8c38ac799d8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:54.677845 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-886112ed-29a3-45d8-b9c8-c8c38ac799d8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:54.678279 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-886112ed-29a3-45d8-b9c8-c8c38ac799d8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:54.750229 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-886112ed-29a3-45d8-b9c8-c8c38ac799d8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:54.758678 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-886112ed-29a3-45d8-b9c8-c8c38ac799d8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1244 microversion: 2.1 time: 0.100860 Jun 03 13:30:54.759252 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 533/983] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:54 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:54.764255 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8fbbd4d7-6ea0-410a-a230-b432a710abd3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:54.764849 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8fbbd4d7-6ea0-410a-a230-b432a710abd3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:54.770647 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8fbbd4d7-6ea0-410a-a230-b432a710abd3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:54.771090 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8fbbd4d7-6ea0-410a-a230-b432a710abd3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:54.771835 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8fbbd4d7-6ea0-410a-a230-b432a710abd3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:54.772448 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8fbbd4d7-6ea0-410a-a230-b432a710abd3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:54.912604 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8fbbd4d7-6ea0-410a-a230-b432a710abd3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:54.920563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8fbbd4d7-6ea0-410a-a230-b432a710abd3 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.159627 Jun 03 13:30:54.955072 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 534/984] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:54 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:55.674150 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5988fcae-c7f1-40aa-bde5-5e04568e6679 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:55.674758 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5988fcae-c7f1-40aa-bde5-5e04568e6679 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:55.682063 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5988fcae-c7f1-40aa-bde5-5e04568e6679 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:55.682535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5988fcae-c7f1-40aa-bde5-5e04568e6679 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:55.683291 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5988fcae-c7f1-40aa-bde5-5e04568e6679 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:55.683756 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5988fcae-c7f1-40aa-bde5-5e04568e6679 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:55.811352 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5988fcae-c7f1-40aa-bde5-5e04568e6679 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:55.829390 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5988fcae-c7f1-40aa-bde5-5e04568e6679 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:55.832000 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5988fcae-c7f1-40aa-bde5-5e04568e6679 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:55.833513 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5988fcae-c7f1-40aa-bde5-5e04568e6679 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.163312 Jun 03 13:30:55.834875 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 535/985] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:55 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:55.840838 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d25e080d-0c8d-4372-92e3-1ca1c3f11d2b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:55.841894 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d25e080d-0c8d-4372-92e3-1ca1c3f11d2b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:55.848570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d25e080d-0c8d-4372-92e3-1ca1c3f11d2b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:55.849047 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d25e080d-0c8d-4372-92e3-1ca1c3f11d2b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:55.854106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d25e080d-0c8d-4372-92e3-1ca1c3f11d2b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:55.854106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d25e080d-0c8d-4372-92e3-1ca1c3f11d2b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:55.869115 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:55.920582 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d25e080d-0c8d-4372-92e3-1ca1c3f11d2b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:55.929592 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d25e080d-0c8d-4372-92e3-1ca1c3f11d2b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1236 microversion: 2.1 time: 0.092483 Jun 03 13:30:55.930653 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 536/986] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:55 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1236 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:55.970570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ab487e5b-a9d2-4f13-aa29-8b28bd92209a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:55.971364 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ab487e5b-a9d2-4f13-aa29-8b28bd92209a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:55.977947 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ab487e5b-a9d2-4f13-aa29-8b28bd92209a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:55.978393 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ab487e5b-a9d2-4f13-aa29-8b28bd92209a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:55.979162 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ab487e5b-a9d2-4f13-aa29-8b28bd92209a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:55.979597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ab487e5b-a9d2-4f13-aa29-8b28bd92209a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:56.121613 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ab487e5b-a9d2-4f13-aa29-8b28bd92209a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:56.130068 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ab487e5b-a9d2-4f13-aa29-8b28bd92209a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.163550 Jun 03 13:30:56.130843 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 537/987] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:55 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:56.330383 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8cff4bce-8656-4d0f-8748-3d444250b278 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "POST /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.320320 Jun 03 13:30:56.331085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 451/988] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:30:47 2022] POST /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments => generated 194 bytes in 9322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:56.853664 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a97c288d-64b8-495d-b741-b17df6fdd88f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:56.854236 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a97c288d-64b8-495d-b741-b17df6fdd88f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:56.860741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a97c288d-64b8-495d-b741-b17df6fdd88f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:56.861189 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a97c288d-64b8-495d-b741-b17df6fdd88f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:56.861941 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a97c288d-64b8-495d-b741-b17df6fdd88f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:56.862373 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a97c288d-64b8-495d-b741-b17df6fdd88f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:56.947962 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9ccd7a18-7942-403e-856e-dba57d7fdeee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:56.949574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-9ccd7a18-7942-403e-856e-dba57d7fdeee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:56.956476 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9ccd7a18-7942-403e-856e-dba57d7fdeee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:56.956930 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9ccd7a18-7942-403e-856e-dba57d7fdeee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:56.957708 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9ccd7a18-7942-403e-856e-dba57d7fdeee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:56.958147 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9ccd7a18-7942-403e-856e-dba57d7fdeee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:57.004459 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a97c288d-64b8-495d-b741-b17df6fdd88f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:57.014431 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a97c288d-64b8-495d-b741-b17df6fdd88f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:57.016023 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a97c288d-64b8-495d-b741-b17df6fdd88f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:57.017328 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a97c288d-64b8-495d-b741-b17df6fdd88f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.168105 Jun 03 13:30:57.022661 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 538/989] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:56 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:30:57.032594 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9ccd7a18-7942-403e-856e-dba57d7fdeee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:57.040631 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9ccd7a18-7942-403e-856e-dba57d7fdeee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1292 microversion: 2.1 time: 0.096880 Jun 03 13:30:57.041192 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 452/990] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:56 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1292 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:57.147051 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-25f448ce-f8c5-498f-a6a6-82bde7688fed tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:57.148557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-25f448ce-f8c5-498f-a6a6-82bde7688fed tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:57.154671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-25f448ce-f8c5-498f-a6a6-82bde7688fed tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:57.155123 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-25f448ce-f8c5-498f-a6a6-82bde7688fed tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:57.155881 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-25f448ce-f8c5-498f-a6a6-82bde7688fed tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:57.156344 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-25f448ce-f8c5-498f-a6a6-82bde7688fed tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:57.290896 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-25f448ce-f8c5-498f-a6a6-82bde7688fed tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:57.298262 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-25f448ce-f8c5-498f-a6a6-82bde7688fed tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.155417 Jun 03 13:30:57.299904 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 539/991] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:57 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:58.035809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-07f139c7-2a63-4839-a467-ee57c48eb25d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:58.036443 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-07f139c7-2a63-4839-a467-ee57c48eb25d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:58.043552 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-07f139c7-2a63-4839-a467-ee57c48eb25d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:58.044003 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-07f139c7-2a63-4839-a467-ee57c48eb25d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:58.044806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-07f139c7-2a63-4839-a467-ee57c48eb25d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:58.045247 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-07f139c7-2a63-4839-a467-ee57c48eb25d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:58.057605 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ec8a18fb-a65d-46e6-9ef1-4a99e1077a04 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:58.058212 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ec8a18fb-a65d-46e6-9ef1-4a99e1077a04 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:58.064104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ec8a18fb-a65d-46e6-9ef1-4a99e1077a04 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:58.064583 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ec8a18fb-a65d-46e6-9ef1-4a99e1077a04 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:58.065338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ec8a18fb-a65d-46e6-9ef1-4a99e1077a04 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:58.065765 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ec8a18fb-a65d-46e6-9ef1-4a99e1077a04 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:58.126390 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ec8a18fb-a65d-46e6-9ef1-4a99e1077a04 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:58.134228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ec8a18fb-a65d-46e6-9ef1-4a99e1077a04 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1300 microversion: 2.1 time: 0.081033 Jun 03 13:30:58.134793 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 540/992] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:58 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1300 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:30:58.177753 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-07f139c7-2a63-4839-a467-ee57c48eb25d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:58.186408 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-07f139c7-2a63-4839-a467-ee57c48eb25d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:58.187913 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-07f139c7-2a63-4839-a467-ee57c48eb25d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:58.189089 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-07f139c7-2a63-4839-a467-ee57c48eb25d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.157320 Jun 03 13:30:58.189649 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 453/993] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:58 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:58.315125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a3e2b79b-39b0-4fc1-9b4a-5f6854322d1a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:58.315662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a3e2b79b-39b0-4fc1-9b4a-5f6854322d1a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:58.322553 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a3e2b79b-39b0-4fc1-9b4a-5f6854322d1a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:58.323002 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a3e2b79b-39b0-4fc1-9b4a-5f6854322d1a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:58.323765 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a3e2b79b-39b0-4fc1-9b4a-5f6854322d1a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:58.324229 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a3e2b79b-39b0-4fc1-9b4a-5f6854322d1a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:58.454597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a3e2b79b-39b0-4fc1-9b4a-5f6854322d1a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:58.462811 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a3e2b79b-39b0-4fc1-9b4a-5f6854322d1a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.151669 Jun 03 13:30:58.472178 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 541/994] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:58 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:59.152113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-923800b0-055c-42f8-acab-3bf4415341be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:59.152768 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-923800b0-055c-42f8-acab-3bf4415341be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:59.159262 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-923800b0-055c-42f8-acab-3bf4415341be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:59.159713 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-923800b0-055c-42f8-acab-3bf4415341be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:59.160498 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-923800b0-055c-42f8-acab-3bf4415341be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:59.160932 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-923800b0-055c-42f8-acab-3bf4415341be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:59.206985 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-593f0c82-9561-411f-a4a6-8cc173ad954b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:59.207595 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-593f0c82-9561-411f-a4a6-8cc173ad954b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:59.214624 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-593f0c82-9561-411f-a4a6-8cc173ad954b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:59.215082 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-593f0c82-9561-411f-a4a6-8cc173ad954b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:59.215850 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-593f0c82-9561-411f-a4a6-8cc173ad954b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:59.216325 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-593f0c82-9561-411f-a4a6-8cc173ad954b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:59.252059 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-923800b0-055c-42f8-acab-3bf4415341be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:59.260362 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-923800b0-055c-42f8-acab-3bf4415341be tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1300 microversion: 2.1 time: 0.113266 Jun 03 13:30:59.261221 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 454/995] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:59 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:59.351570 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-593f0c82-9561-411f-a4a6-8cc173ad954b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:59.360331 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-593f0c82-9561-411f-a4a6-8cc173ad954b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:59.361836 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-593f0c82-9561-411f-a4a6-8cc173ad954b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:59.363147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-593f0c82-9561-411f-a4a6-8cc173ad954b tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.160249 Jun 03 13:30:59.363708 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 542/996] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:30:59 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:30:59.480348 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-19bd4630-d2d5-481b-be1e-b1a43c445c31 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:59.480988 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-19bd4630-d2d5-481b-be1e-b1a43c445c31 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:59.487164 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19bd4630-d2d5-481b-be1e-b1a43c445c31 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:59.487614 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19bd4630-d2d5-481b-be1e-b1a43c445c31 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:59.488415 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19bd4630-d2d5-481b-be1e-b1a43c445c31 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:59.488905 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-19bd4630-d2d5-481b-be1e-b1a43c445c31 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:59.690572 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-19bd4630-d2d5-481b-be1e-b1a43c445c31 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:59.699312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-19bd4630-d2d5-481b-be1e-b1a43c445c31 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.223559 Jun 03 13:30:59.699891 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 455/997] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:59 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:00.277048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d0d30d06-36bb-4475-80a6-1d86f92d58b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:00.277754 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d0d30d06-36bb-4475-80a6-1d86f92d58b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:00.284017 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d0d30d06-36bb-4475-80a6-1d86f92d58b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:00.284506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d0d30d06-36bb-4475-80a6-1d86f92d58b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:00.285281 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d0d30d06-36bb-4475-80a6-1d86f92d58b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:00.285722 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d0d30d06-36bb-4475-80a6-1d86f92d58b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:00.387083 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-227c0331-e393-4b76-af61-3df8126f7ead tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:00.387696 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-227c0331-e393-4b76-af61-3df8126f7ead tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:00.402981 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-227c0331-e393-4b76-af61-3df8126f7ead tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:00.403440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-227c0331-e393-4b76-af61-3df8126f7ead tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:00.404250 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-227c0331-e393-4b76-af61-3df8126f7ead tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:00.405023 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-227c0331-e393-4b76-af61-3df8126f7ead tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:00.424928 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d0d30d06-36bb-4475-80a6-1d86f92d58b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:00.431876 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:00.434970 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d0d30d06-36bb-4475-80a6-1d86f92d58b9 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1365 microversion: 2.1 time: 0.161785 Jun 03 13:31:00.435564 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 543/998] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:00 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:00.643236 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-227c0331-e393-4b76-af61-3df8126f7ead tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:00.653543 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-227c0331-e393-4b76-af61-3df8126f7ead tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:00.654650 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-227c0331-e393-4b76-af61-3df8126f7ead tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:00.655862 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-227c0331-e393-4b76-af61-3df8126f7ead tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.272714 Jun 03 13:31:00.656601 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 456/999] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:31:00 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:31:00.711889 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-e173c4f3-9853-4d2a-8d4b-d749948d84c6 req-4439d517-51fb-4ba2-a63b-df7191cea7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f51fd4a-3353-43f3-b528-c767e6b916d8", "name": "network-vif-plugged", "status": "completed", "tag": "173fe60e-b29a-407d-93fa-37787cf955ce"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:31:00.728013 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-e173c4f3-9853-4d2a-8d4b-d749948d84c6 req-4439d517-51fb-4ba2-a63b-df7191cea7b9 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:00.729826 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b9de0067-46a8-409b-8522-790fb5f3fa7f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:00.730516 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b9de0067-46a8-409b-8522-790fb5f3fa7f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:00.733996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-e173c4f3-9853-4d2a-8d4b-d749948d84c6 req-4439d517-51fb-4ba2-a63b-df7191cea7b9 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:00.745150 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b9de0067-46a8-409b-8522-790fb5f3fa7f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:00.745150 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b9de0067-46a8-409b-8522-790fb5f3fa7f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:00.745150 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b9de0067-46a8-409b-8522-790fb5f3fa7f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:00.746629 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b9de0067-46a8-409b-8522-790fb5f3fa7f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:00.757344 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-e173c4f3-9853-4d2a-8d4b-d749948d84c6 req-4439d517-51fb-4ba2-a63b-df7191cea7b9 service nova] Creating event network-vif-plugged:173fe60e-b29a-407d-93fa-37787cf955ce for instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 on hv-cinder-80135 Jun 03 13:31:00.765139 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-e173c4f3-9853-4d2a-8d4b-d749948d84c6 req-4439d517-51fb-4ba2-a63b-df7191cea7b9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057851 Jun 03 13:31:00.767906 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 544/1000] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:31:00.977068 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b9de0067-46a8-409b-8522-790fb5f3fa7f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:00.985340 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b9de0067-46a8-409b-8522-790fb5f3fa7f tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.267842 Jun 03 13:31:00.995276 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 457/1001] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:00 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:01.205751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-fee5dbf7-b069-4a8f-ac08-8125a01143e4 req-60e62f95-3695-4a2b-babb-93a35119f638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a50313-9112-47c6-b1f5-52c062ac8481", "tag": "2d8c994e-a998-470e-b0af-9852842f12b7"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:31:01.216501 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-fee5dbf7-b069-4a8f-ac08-8125a01143e4 req-60e62f95-3695-4a2b-babb-93a35119f638 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:01.216932 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-fee5dbf7-b069-4a8f-ac08-8125a01143e4 req-60e62f95-3695-4a2b-babb-93a35119f638 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:01.228997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-fee5dbf7-b069-4a8f-ac08-8125a01143e4 req-60e62f95-3695-4a2b-babb-93a35119f638 service nova] Creating event network-changed:2d8c994e-a998-470e-b0af-9852842f12b7 for instance 59a50313-9112-47c6-b1f5-52c062ac8481 on hv-cinder-80135 Jun 03 13:31:01.234710 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-fee5dbf7-b069-4a8f-ac08-8125a01143e4 req-60e62f95-3695-4a2b-babb-93a35119f638 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033362 Jun 03 13:31:01.235328 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 545/1002] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:31:01.452314 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7fdc54e9-1192-4eb9-a31c-e7d6ec232346 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:01.452903 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-7fdc54e9-1192-4eb9-a31c-e7d6ec232346 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:01.459265 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7fdc54e9-1192-4eb9-a31c-e7d6ec232346 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:01.459771 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7fdc54e9-1192-4eb9-a31c-e7d6ec232346 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:01.460660 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7fdc54e9-1192-4eb9-a31c-e7d6ec232346 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:01.461089 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7fdc54e9-1192-4eb9-a31c-e7d6ec232346 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:01.621772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-7fdc54e9-1192-4eb9-a31c-e7d6ec232346 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:01.630844 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-7fdc54e9-1192-4eb9-a31c-e7d6ec232346 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1365 microversion: 2.1 time: 0.182618 Jun 03 13:31:01.631411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 458/1003] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:01 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:01.675651 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-082e288f-8376-4c1b-8f30-9b26e2a9b4da tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:01.676402 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-082e288f-8376-4c1b-8f30-9b26e2a9b4da tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:01.683759 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-082e288f-8376-4c1b-8f30-9b26e2a9b4da tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:01.684246 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-082e288f-8376-4c1b-8f30-9b26e2a9b4da tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:01.685015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-082e288f-8376-4c1b-8f30-9b26e2a9b4da tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:01.685458 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-082e288f-8376-4c1b-8f30-9b26e2a9b4da tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:01.819571 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-082e288f-8376-4c1b-8f30-9b26e2a9b4da tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:01.827797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-082e288f-8376-4c1b-8f30-9b26e2a9b4da tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:01.829336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-082e288f-8376-4c1b-8f30-9b26e2a9b4da tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:01.830504 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-082e288f-8376-4c1b-8f30-9b26e2a9b4da tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.159590 Jun 03 13:31:01.831060 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 546/1004] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:31:01 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:31:02.003029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-299aa1cf-19b8-4e27-9795-e028f67eb35d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:02.003641 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-299aa1cf-19b8-4e27-9795-e028f67eb35d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:02.009712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-299aa1cf-19b8-4e27-9795-e028f67eb35d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:02.010161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-299aa1cf-19b8-4e27-9795-e028f67eb35d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:02.010921 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-299aa1cf-19b8-4e27-9795-e028f67eb35d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:02.011357 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-299aa1cf-19b8-4e27-9795-e028f67eb35d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:02.137083 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-299aa1cf-19b8-4e27-9795-e028f67eb35d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:02.144492 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-299aa1cf-19b8-4e27-9795-e028f67eb35d tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.145569 Jun 03 13:31:02.145076 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 459/1005] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:01 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:02.651004 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-907d593b-060d-4075-a229-490c761757e3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:02.651609 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-907d593b-060d-4075-a229-490c761757e3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:02.657633 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-907d593b-060d-4075-a229-490c761757e3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:02.658083 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-907d593b-060d-4075-a229-490c761757e3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:02.658883 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-907d593b-060d-4075-a229-490c761757e3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:02.659297 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-907d593b-060d-4075-a229-490c761757e3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:02.779484 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-c9964da5-8630-4bba-b2d9-1577ac26acd2 req-aeafae87-01d4-44c2-bde2-853f032b6385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1becd265-d1f3-43ec-8942-19241f1e3430", "name": "network-vif-plugged", "status": "completed", "tag": "4d677ea9-f6d0-42a2-9591-d5a1d8554ed8"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:31:02.788883 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-c9964da5-8630-4bba-b2d9-1577ac26acd2 req-aeafae87-01d4-44c2-bde2-853f032b6385 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:02.789335 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-c9964da5-8630-4bba-b2d9-1577ac26acd2 req-aeafae87-01d4-44c2-bde2-853f032b6385 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:02.796480 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-907d593b-060d-4075-a229-490c761757e3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:02.800497 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-c9964da5-8630-4bba-b2d9-1577ac26acd2 req-aeafae87-01d4-44c2-bde2-853f032b6385 service nova] Creating event network-vif-plugged:4d677ea9-f6d0-42a2-9591-d5a1d8554ed8 for instance 1becd265-d1f3-43ec-8942-19241f1e3430 on hv-cinder-80135 Jun 03 13:31:02.804943 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-907d593b-060d-4075-a229-490c761757e3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1365 microversion: 2.1 time: 0.158663 Jun 03 13:31:02.805356 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-c9964da5-8630-4bba-b2d9-1577ac26acd2 req-aeafae87-01d4-44c2-bde2-853f032b6385 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029574 Jun 03 13:31:02.812201 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 547/1006] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:02 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:02.812757 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 460/1007] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:31:02.847859 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-aa09d37b-86cf-47f7-a0c0-8180b010ed3d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:02.848537 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-aa09d37b-86cf-47f7-a0c0-8180b010ed3d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:02.854910 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aa09d37b-86cf-47f7-a0c0-8180b010ed3d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:02.855366 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aa09d37b-86cf-47f7-a0c0-8180b010ed3d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:02.856124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aa09d37b-86cf-47f7-a0c0-8180b010ed3d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:02.856610 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aa09d37b-86cf-47f7-a0c0-8180b010ed3d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:02.992667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-aa09d37b-86cf-47f7-a0c0-8180b010ed3d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:03.001601 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-aa09d37b-86cf-47f7-a0c0-8180b010ed3d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:03.003367 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-aa09d37b-86cf-47f7-a0c0-8180b010ed3d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:03.005274 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-aa09d37b-86cf-47f7-a0c0-8180b010ed3d tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.160659 Jun 03 13:31:03.005274 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 548/1008] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:31:02 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:31:03.162772 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-99ff264a-9bae-442f-8579-2adc21d7cc1e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:03.163798 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-99ff264a-9bae-442f-8579-2adc21d7cc1e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:03.171391 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-99ff264a-9bae-442f-8579-2adc21d7cc1e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:03.171915 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-99ff264a-9bae-442f-8579-2adc21d7cc1e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:03.173278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-99ff264a-9bae-442f-8579-2adc21d7cc1e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:03.173497 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-99ff264a-9bae-442f-8579-2adc21d7cc1e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:03.308535 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-99ff264a-9bae-442f-8579-2adc21d7cc1e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:03.315909 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-99ff264a-9bae-442f-8579-2adc21d7cc1e tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.157386 Jun 03 13:31:03.319593 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 461/1009] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:03 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:03.821989 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-663c514a-2252-4ab8-b518-eff1fa746972 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:03.822600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-663c514a-2252-4ab8-b518-eff1fa746972 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:03.829167 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-663c514a-2252-4ab8-b518-eff1fa746972 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:03.829751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-663c514a-2252-4ab8-b518-eff1fa746972 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:03.830516 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-663c514a-2252-4ab8-b518-eff1fa746972 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:03.830958 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-663c514a-2252-4ab8-b518-eff1fa746972 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:03.960774 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-663c514a-2252-4ab8-b518-eff1fa746972 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:03.968357 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-663c514a-2252-4ab8-b518-eff1fa746972 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1365 microversion: 2.1 time: 0.150322 Jun 03 13:31:03.968943 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 549/1010] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:03 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:04.024612 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4d1f1fbb-b5de-46c6-8121-bdaa6a5ec7aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:04.025148 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4d1f1fbb-b5de-46c6-8121-bdaa6a5ec7aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:04.031412 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4d1f1fbb-b5de-46c6-8121-bdaa6a5ec7aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:04.031863 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4d1f1fbb-b5de-46c6-8121-bdaa6a5ec7aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:04.032662 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4d1f1fbb-b5de-46c6-8121-bdaa6a5ec7aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:04.033102 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4d1f1fbb-b5de-46c6-8121-bdaa6a5ec7aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:04.166399 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4d1f1fbb-b5de-46c6-8121-bdaa6a5ec7aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:04.174187 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4d1f1fbb-b5de-46c6-8121-bdaa6a5ec7aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:04.175729 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4d1f1fbb-b5de-46c6-8121-bdaa6a5ec7aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:04.176970 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4d1f1fbb-b5de-46c6-8121-bdaa6a5ec7aa tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.157761 Jun 03 13:31:04.177622 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 462/1011] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:31:04 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:31:04.332939 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2adb7d7d-3ba1-4c7d-906d-4b21cc99991c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:04.333472 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2adb7d7d-3ba1-4c7d-906d-4b21cc99991c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:04.336259 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:04.340975 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2adb7d7d-3ba1-4c7d-906d-4b21cc99991c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:04.341420 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2adb7d7d-3ba1-4c7d-906d-4b21cc99991c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:04.342173 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2adb7d7d-3ba1-4c7d-906d-4b21cc99991c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:04.342605 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2adb7d7d-3ba1-4c7d-906d-4b21cc99991c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:04.473319 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2adb7d7d-3ba1-4c7d-906d-4b21cc99991c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:04.480888 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2adb7d7d-3ba1-4c7d-906d-4b21cc99991c tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.151848 Jun 03 13:31:04.481458 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 550/1012] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:04 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:04.986218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4508f61a-0d92-486f-ad0c-625af34b8834 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:04.986826 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4508f61a-0d92-486f-ad0c-625af34b8834 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:04.993783 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4508f61a-0d92-486f-ad0c-625af34b8834 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:04.994242 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4508f61a-0d92-486f-ad0c-625af34b8834 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:04.995013 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4508f61a-0d92-486f-ad0c-625af34b8834 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:04.995452 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4508f61a-0d92-486f-ad0c-625af34b8834 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:05.127388 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4508f61a-0d92-486f-ad0c-625af34b8834 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:05.136010 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4508f61a-0d92-486f-ad0c-625af34b8834 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1365 microversion: 2.1 time: 0.153600 Jun 03 13:31:05.136905 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 463/1013] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:04 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:05.194875 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a6203fcc-4664-49e9-b0da-08fc48f37b9a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:05.195609 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a6203fcc-4664-49e9-b0da-08fc48f37b9a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:05.202482 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a6203fcc-4664-49e9-b0da-08fc48f37b9a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:05.203015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a6203fcc-4664-49e9-b0da-08fc48f37b9a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:05.203849 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a6203fcc-4664-49e9-b0da-08fc48f37b9a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:05.204946 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a6203fcc-4664-49e9-b0da-08fc48f37b9a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:05.349255 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a6203fcc-4664-49e9-b0da-08fc48f37b9a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:05.359011 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a6203fcc-4664-49e9-b0da-08fc48f37b9a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:05.360577 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a6203fcc-4664-49e9-b0da-08fc48f37b9a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:05.361789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a6203fcc-4664-49e9-b0da-08fc48f37b9a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1732 microversion: 2.20 time: 0.170856 Jun 03 13:31:05.362387 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 551/1014] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:31:05 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:31:05.497439 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9de9f130-eaa9-42ea-8ffc-440ba2416961 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:05.498052 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-9de9f130-eaa9-42ea-8ffc-440ba2416961 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:05.504419 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9de9f130-eaa9-42ea-8ffc-440ba2416961 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:05.504864 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9de9f130-eaa9-42ea-8ffc-440ba2416961 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:05.505802 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9de9f130-eaa9-42ea-8ffc-440ba2416961 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:05.506142 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9de9f130-eaa9-42ea-8ffc-440ba2416961 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:05.640397 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9de9f130-eaa9-42ea-8ffc-440ba2416961 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:05.648728 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9de9f130-eaa9-42ea-8ffc-440ba2416961 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.155134 Jun 03 13:31:05.649298 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 464/1015] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:05 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:06.152912 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5a7549e0-e1c3-4c69-aa74-c46d8d71e2bb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:06.153538 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5a7549e0-e1c3-4c69-aa74-c46d8d71e2bb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:06.159553 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5a7549e0-e1c3-4c69-aa74-c46d8d71e2bb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:06.160001 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5a7549e0-e1c3-4c69-aa74-c46d8d71e2bb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:06.160805 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5a7549e0-e1c3-4c69-aa74-c46d8d71e2bb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:06.161241 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5a7549e0-e1c3-4c69-aa74-c46d8d71e2bb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:06.286527 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5a7549e0-e1c3-4c69-aa74-c46d8d71e2bb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:06.294577 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5a7549e0-e1c3-4c69-aa74-c46d8d71e2bb tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1365 microversion: 2.1 time: 0.145701 Jun 03 13:31:06.295154 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 552/1016] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:06 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:31:06.380685 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-9675f707-612c-40da-a51d-7f00e9f75b7e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:06.381285 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-9675f707-612c-40da-a51d-7f00e9f75b7e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:06.388012 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9675f707-612c-40da-a51d-7f00e9f75b7e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:06.388489 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9675f707-612c-40da-a51d-7f00e9f75b7e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:06.389239 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9675f707-612c-40da-a51d-7f00e9f75b7e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:06.389671 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-9675f707-612c-40da-a51d-7f00e9f75b7e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:06.519917 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9675f707-612c-40da-a51d-7f00e9f75b7e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:06.527988 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9675f707-612c-40da-a51d-7f00e9f75b7e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:06.529510 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-9675f707-612c-40da-a51d-7f00e9f75b7e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:06.530651 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-9675f707-612c-40da-a51d-7f00e9f75b7e tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1719 microversion: 2.20 time: 0.154203 Jun 03 13:31:06.531212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 465/1017] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:31:06 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:31:06.665982 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2f19300f-4b94-40f6-bdff-ca6953190b27 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:06.666593 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2f19300f-4b94-40f6-bdff-ca6953190b27 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:06.672534 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2f19300f-4b94-40f6-bdff-ca6953190b27 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:06.672980 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2f19300f-4b94-40f6-bdff-ca6953190b27 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:06.673730 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2f19300f-4b94-40f6-bdff-ca6953190b27 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:06.674161 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2f19300f-4b94-40f6-bdff-ca6953190b27 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:06.808574 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2f19300f-4b94-40f6-bdff-ca6953190b27 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:06.816004 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2f19300f-4b94-40f6-bdff-ca6953190b27 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1313 microversion: 2.1 time: 0.154474 Jun 03 13:31:06.816783 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 553/1018] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:06 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:07.311298 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8c546668-ab8d-4119-9ed9-f55ffa38e078 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:07.312023 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8c546668-ab8d-4119-9ed9-f55ffa38e078 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:07.318619 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8c546668-ab8d-4119-9ed9-f55ffa38e078 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:07.320235 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8c546668-ab8d-4119-9ed9-f55ffa38e078 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:07.321234 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8c546668-ab8d-4119-9ed9-f55ffa38e078 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:07.322033 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8c546668-ab8d-4119-9ed9-f55ffa38e078 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:07.519855 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8c546668-ab8d-4119-9ed9-f55ffa38e078 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:07.529239 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8c546668-ab8d-4119-9ed9-f55ffa38e078 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1365 microversion: 2.1 time: 0.221726 Jun 03 13:31:07.529814 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 466/1019] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:07 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:07.835703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ce373a40-0e3a-4cbf-91ff-705848510d07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:07.836250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ce373a40-0e3a-4cbf-91ff-705848510d07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:07.842813 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ce373a40-0e3a-4cbf-91ff-705848510d07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:07.843266 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ce373a40-0e3a-4cbf-91ff-705848510d07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:07.844031 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ce373a40-0e3a-4cbf-91ff-705848510d07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:07.844506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ce373a40-0e3a-4cbf-91ff-705848510d07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:07.862755 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:07.975602 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ce373a40-0e3a-4cbf-91ff-705848510d07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:07.983625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ce373a40-0e3a-4cbf-91ff-705848510d07 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1498 microversion: 2.1 time: 0.152633 Jun 03 13:31:07.984450 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 554/1020] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:07 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:08.056924 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7252d3f5-09cc-437b-a5d3-e2cbcd7795ce tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:08.057922 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-7252d3f5-09cc-437b-a5d3-e2cbcd7795ce tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:08.064273 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7252d3f5-09cc-437b-a5d3-e2cbcd7795ce tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:08.064729 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7252d3f5-09cc-437b-a5d3-e2cbcd7795ce tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:08.065606 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7252d3f5-09cc-437b-a5d3-e2cbcd7795ce tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:08.066018 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7252d3f5-09cc-437b-a5d3-e2cbcd7795ce tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:08.094665 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-7252d3f5-09cc-437b-a5d3-e2cbcd7795ce tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042373 Jun 03 13:31:08.095153 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 467/1021] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:31:08 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:31:08.105445 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1666d335-b85d-4dbe-99e9-0f3460e06ff0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:08.105944 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-1666d335-b85d-4dbe-99e9-0f3460e06ff0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:08.112013 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1666d335-b85d-4dbe-99e9-0f3460e06ff0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:08.112435 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1666d335-b85d-4dbe-99e9-0f3460e06ff0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:08.113231 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1666d335-b85d-4dbe-99e9-0f3460e06ff0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:08.113673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1666d335-b85d-4dbe-99e9-0f3460e06ff0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:08.142958 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1666d335-b85d-4dbe-99e9-0f3460e06ff0 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments/355d39fa-cf37-4705-8c80-907c01500e18" status: 200 len: 194 microversion: 2.1 time: 0.041936 Jun 03 13:31:08.143537 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 555/1022] 10.222.0.61 () {58 vars in 1412 bytes} [Fri Jun 3 13:31:08 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments/355d39fa-cf37-4705-8c80-907c01500e18 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:31:08.548231 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-fb5093be-92bc-4762-bd1c-d852c0ebc8a8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:08.549420 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-fb5093be-92bc-4762-bd1c-d852c0ebc8a8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:08.560118 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fb5093be-92bc-4762-bd1c-d852c0ebc8a8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:08.560898 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fb5093be-92bc-4762-bd1c-d852c0ebc8a8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:08.562174 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fb5093be-92bc-4762-bd1c-d852c0ebc8a8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:08.562910 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fb5093be-92bc-4762-bd1c-d852c0ebc8a8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:08.653166 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-3009cdb8-1f1c-4e4a-9ba1-21d1966b7b47 req-1dcb6554-6657-4d28-aada-07d4460f9889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a50313-9112-47c6-b1f5-52c062ac8481", "name": "network-vif-plugged", "status": "completed", "tag": "2d8c994e-a998-470e-b0af-9852842f12b7"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:31:08.670016 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-3009cdb8-1f1c-4e4a-9ba1-21d1966b7b47 req-1dcb6554-6657-4d28-aada-07d4460f9889 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:08.670016 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-3009cdb8-1f1c-4e4a-9ba1-21d1966b7b47 req-1dcb6554-6657-4d28-aada-07d4460f9889 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:08.680122 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-3009cdb8-1f1c-4e4a-9ba1-21d1966b7b47 req-1dcb6554-6657-4d28-aada-07d4460f9889 service nova] Creating event network-vif-plugged:2d8c994e-a998-470e-b0af-9852842f12b7 for instance 59a50313-9112-47c6-b1f5-52c062ac8481 on hv-cinder-80135 Jun 03 13:31:08.685927 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-3009cdb8-1f1c-4e4a-9ba1-21d1966b7b47 req-1dcb6554-6657-4d28-aada-07d4460f9889 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036991 Jun 03 13:31:08.686612 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 556/1023] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:31:08.702758 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-fb5093be-92bc-4762-bd1c-d852c0ebc8a8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:08.710571 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-fb5093be-92bc-4762-bd1c-d852c0ebc8a8 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1365 microversion: 2.1 time: 0.167423 Jun 03 13:31:08.712191 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 468/1024] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:08 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:08.809266 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-829bbdc4-a534-4797-a954-a7b57d42de6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:08.809853 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-829bbdc4-a534-4797-a954-a7b57d42de6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:08.816130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-829bbdc4-a534-4797-a954-a7b57d42de6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:08.816512 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-829bbdc4-a534-4797-a954-a7b57d42de6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:08.817456 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-829bbdc4-a534-4797-a954-a7b57d42de6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:08.817890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-829bbdc4-a534-4797-a954-a7b57d42de6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:08.847437 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-829bbdc4-a534-4797-a954-a7b57d42de6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Going to try to terminate instance {{(pid=118179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:31:09.097918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-829bbdc4-a534-4797-a954-a7b57d42de6a tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 204 len: 0 microversion: 2.1 time: 0.292819 Jun 03 13:31:09.098659 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 557/1025] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:31:08 2022] DELETE /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:31:09.107152 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e081dd99-21e3-45fa-9352-a30a83e8f306 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:09.107770 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e081dd99-21e3-45fa-9352-a30a83e8f306 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:09.113794 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e081dd99-21e3-45fa-9352-a30a83e8f306 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:09.114270 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e081dd99-21e3-45fa-9352-a30a83e8f306 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:09.115039 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e081dd99-21e3-45fa-9352-a30a83e8f306 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:09.115478 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e081dd99-21e3-45fa-9352-a30a83e8f306 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:09.243815 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e081dd99-21e3-45fa-9352-a30a83e8f306 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:09.251393 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e081dd99-21e3-45fa-9352-a30a83e8f306 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1504 microversion: 2.1 time: 0.148287 Jun 03 13:31:09.252226 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 469/1026] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:09 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:09.729935 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0f377fc9-23af-45c7-ba1a-44814d20ba49 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:09.730629 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0f377fc9-23af-45c7-ba1a-44814d20ba49 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:09.737068 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0f377fc9-23af-45c7-ba1a-44814d20ba49 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:09.737519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0f377fc9-23af-45c7-ba1a-44814d20ba49 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:09.738278 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0f377fc9-23af-45c7-ba1a-44814d20ba49 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:09.738890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0f377fc9-23af-45c7-ba1a-44814d20ba49 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:09.786349 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0dfdee0f-fe98-405f-a3bd-39f212c7e76d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfc64f47-e179-4f51-b3eb-5086d2cee7af"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:31:09.787486 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0dfdee0f-fe98-405f-a3bd-39f212c7e76d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:09.794927 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0dfdee0f-fe98-405f-a3bd-39f212c7e76d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:09.795378 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0dfdee0f-fe98-405f-a3bd-39f212c7e76d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:09.796228 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0dfdee0f-fe98-405f-a3bd-39f212c7e76d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:09.796671 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0dfdee0f-fe98-405f-a3bd-39f212c7e76d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:09.876294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0f377fc9-23af-45c7-ba1a-44814d20ba49 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:09.884520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0f377fc9-23af-45c7-ba1a-44814d20ba49 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1365 microversion: 2.1 time: 0.159580 Jun 03 13:31:09.885089 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 558/1027] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:09 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:10.270071 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0f0e706c-cf40-42c5-867f-7e89f5345d23 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:10.270612 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0f0e706c-cf40-42c5-867f-7e89f5345d23 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:10.277430 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0f0e706c-cf40-42c5-867f-7e89f5345d23 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:10.277887 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0f0e706c-cf40-42c5-867f-7e89f5345d23 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:10.278652 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0f0e706c-cf40-42c5-867f-7e89f5345d23 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:10.279095 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0f0e706c-cf40-42c5-867f-7e89f5345d23 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:10.404971 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0f0e706c-cf40-42c5-867f-7e89f5345d23 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:10.412290 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0f0e706c-cf40-42c5-867f-7e89f5345d23 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1504 microversion: 2.1 time: 0.146203 Jun 03 13:31:10.412847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 559/1028] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:10 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:31:10.902091 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0a66de8e-fc5b-476e-8e42-eb93b2bc030f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:10.902747 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0a66de8e-fc5b-476e-8e42-eb93b2bc030f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:10.909451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0a66de8e-fc5b-476e-8e42-eb93b2bc030f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:10.909913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0a66de8e-fc5b-476e-8e42-eb93b2bc030f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:10.910681 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0a66de8e-fc5b-476e-8e42-eb93b2bc030f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:10.911123 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0a66de8e-fc5b-476e-8e42-eb93b2bc030f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:11.041760 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0a66de8e-fc5b-476e-8e42-eb93b2bc030f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:11.049336 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0a66de8e-fc5b-476e-8e42-eb93b2bc030f tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1365 microversion: 2.1 time: 0.152027 Jun 03 13:31:11.049902 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 560/1029] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:10 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:31:11.429164 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2a836a32-3c2d-4d9a-9555-9ac2ba0ce381 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:11.430280 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2a836a32-3c2d-4d9a-9555-9ac2ba0ce381 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:11.436262 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2a836a32-3c2d-4d9a-9555-9ac2ba0ce381 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:11.436771 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2a836a32-3c2d-4d9a-9555-9ac2ba0ce381 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:11.437546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2a836a32-3c2d-4d9a-9555-9ac2ba0ce381 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:11.437988 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2a836a32-3c2d-4d9a-9555-9ac2ba0ce381 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:11.583415 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2a836a32-3c2d-4d9a-9555-9ac2ba0ce381 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:11.591299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2a836a32-3c2d-4d9a-9555-9ac2ba0ce381 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1504 microversion: 2.1 time: 0.166079 Jun 03 13:31:11.591874 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 561/1030] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:11 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:31:11.854312 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-8428ded5-0606-48b4-84c1-864fb7846096 req-215ce863-2dec-4a5c-a5a9-14b71786b30b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1becd265-d1f3-43ec-8942-19241f1e3430", "name": "network-vif-deleted", "tag": "4d677ea9-f6d0-42a2-9591-d5a1d8554ed8"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:31:11.863618 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-8428ded5-0606-48b4-84c1-864fb7846096 req-215ce863-2dec-4a5c-a5a9-14b71786b30b service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:11.864063 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-8428ded5-0606-48b4-84c1-864fb7846096 req-215ce863-2dec-4a5c-a5a9-14b71786b30b service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:11.874969 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-8428ded5-0606-48b4-84c1-864fb7846096 req-215ce863-2dec-4a5c-a5a9-14b71786b30b service nova] Creating event network-vif-deleted:4d677ea9-f6d0-42a2-9591-d5a1d8554ed8 for instance 1becd265-d1f3-43ec-8942-19241f1e3430 on hv-cinder-80135 Jun 03 13:31:11.880010 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-8428ded5-0606-48b4-84c1-864fb7846096 req-215ce863-2dec-4a5c-a5a9-14b71786b30b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030290 Jun 03 13:31:11.880661 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 562/1031] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:31:11.912858 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0dfdee0f-fe98-405f-a3bd-39f212c7e76d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "POST /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.130547 Jun 03 13:31:11.913491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 470/1032] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:31:09 2022] POST /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments => generated 194 bytes in 2132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:31:12.067367 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-7bf7c1b5-8a69-40be-b040-c71533bb760d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:12.068064 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-7bf7c1b5-8a69-40be-b040-c71533bb760d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:12.074351 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7bf7c1b5-8a69-40be-b040-c71533bb760d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:12.074801 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7bf7c1b5-8a69-40be-b040-c71533bb760d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:12.075558 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7bf7c1b5-8a69-40be-b040-c71533bb760d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:12.075994 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-7bf7c1b5-8a69-40be-b040-c71533bb760d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:12.212126 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-7bf7c1b5-8a69-40be-b040-c71533bb760d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:12.221248 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-7bf7c1b5-8a69-40be-b040-c71533bb760d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1365 microversion: 2.1 time: 0.158600 Jun 03 13:31:12.222022 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 563/1033] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:12 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:12.609657 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0882130a-2ffb-479d-9a00-b888cee21585 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:12.610283 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0882130a-2ffb-479d-9a00-b888cee21585 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:12.612218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:12.617808 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0882130a-2ffb-479d-9a00-b888cee21585 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:12.618244 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0882130a-2ffb-479d-9a00-b888cee21585 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:12.618998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0882130a-2ffb-479d-9a00-b888cee21585 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:12.619429 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0882130a-2ffb-479d-9a00-b888cee21585 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:12.651450 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0882130a-2ffb-479d-9a00-b888cee21585 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:12.651886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0882130a-2ffb-479d-9a00-b888cee21585 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:12.652360 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-0882130a-2ffb-479d-9a00-b888cee21585 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lazy-loading 'fault' on Instance uuid 1becd265-d1f3-43ec-8942-19241f1e3430 {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:31:12.698814 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0882130a-2ffb-479d-9a00-b888cee21585 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470975f53c44571be88b20b13d277c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db1c45b9113447b8ffc69365cf598bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:12.707180 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0882130a-2ffb-479d-9a00-b888cee21585 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 200 len: 1303 microversion: 2.1 time: 0.102223 Jun 03 13:31:12.707755 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 471/1034] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:12 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:13.238600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c393846e-78dd-47b5-932d-96960d88f735 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:13.239212 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c393846e-78dd-47b5-932d-96960d88f735 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:13.245837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c393846e-78dd-47b5-932d-96960d88f735 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:13.246281 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c393846e-78dd-47b5-932d-96960d88f735 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:13.247034 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c393846e-78dd-47b5-932d-96960d88f735 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:13.247466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c393846e-78dd-47b5-932d-96960d88f735 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:13.377367 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c393846e-78dd-47b5-932d-96960d88f735 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:13.385694 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c393846e-78dd-47b5-932d-96960d88f735 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1555 microversion: 2.1 time: 0.151067 Jun 03 13:31:13.386193 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 564/1035] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:13 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:13.401838 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ec72aa00-ce25-4180-a5f4-49bd3aabed71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:13.402363 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ec72aa00-ce25-4180-a5f4-49bd3aabed71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:13.408232 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ec72aa00-ce25-4180-a5f4-49bd3aabed71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:13.408679 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ec72aa00-ce25-4180-a5f4-49bd3aabed71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:13.409459 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ec72aa00-ce25-4180-a5f4-49bd3aabed71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:13.409892 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ec72aa00-ce25-4180-a5f4-49bd3aabed71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:13.412500 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:13.487712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ec72aa00-ce25-4180-a5f4-49bd3aabed71 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089737 Jun 03 13:31:13.488347 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 472/1036] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 13:31:13 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:31:13.725251 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d0839f99-7ed6-4984-a0a4-0741b2ffb351 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:13.725986 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d0839f99-7ed6-4984-a0a4-0741b2ffb351 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] [instance: 1becd265-d1f3-43ec-8942-19241f1e3430] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:13.733862 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d0839f99-7ed6-4984-a0a4-0741b2ffb351 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:13.734660 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d0839f99-7ed6-4984-a0a4-0741b2ffb351 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:13.735538 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d0839f99-7ed6-4984-a0a4-0741b2ffb351 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:13.735979 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d0839f99-7ed6-4984-a0a4-0741b2ffb351 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:13.750791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-d0839f99-7ed6-4984-a0a4-0741b2ffb351 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] HTTP exception thrown: Instance 1becd265-d1f3-43ec-8942-19241f1e3430 could not be found. Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d0839f99-7ed6-4984-a0a4-0741b2ffb351 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Request method failure captured: Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 HTTP/1.1 Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgzaAcYywM8tZGO8UZKiLOw_iRKM9IUVhcC0I1z8_urOukE-X-K3PMcD7LOqny-NL_YligCSh2sLgsUFkANp3UXlGNj6ZmJYQvEKu_ObOGNEKWlgkqnc35F2Oh8NTehGOboGhQnN_vZOq50Xgfmu0Cmgt7Qme0HXyEE9N7l-gHG0uM4 Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 8db1c45b9113447b8ffc69365cf598bc Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesActionsTest-123373577 Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:31:13.752822 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:31:13.754508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8db1c45b9113447b8ffc69365cf598bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8db1c45b9113447b8ffc69365cf598bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8db1c45b9113447b8ffc69365cf598bc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8db1c45b9113447b8ffc69365cf598bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:31:13.754508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesActionsTest-123373577 Jun 03 13:31:13.754508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 8db1c45b9113447b8ffc69365cf598bc Jun 03 13:31:13.754508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesActionsTest-123373577 Jun 03 13:31:13.754508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesActionsTest-123373577-project Jun 03 13:31:13.754508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:31:13.754508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:31:13.754508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 1470975f53c44571be88b20b13d277c2 Jun 03 13:31:13.754508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesActionsTest-123373577-project Jun 03 13:31:13.754508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:31:13.754508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 1becd265-d1f3-43ec-8942-19241f1e3430 could not be found. Jun 03 13:31:13.754508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '1becd265-d1f3-43ec-8942-19241f1e3430'} Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1becd265-d1f3-43ec-8942-19241f1e3430 could not be found. Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:31:13.755339 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1becd265-d1f3-43ec-8942-19241f1e3430 could not be found. Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1becd265-d1f3-43ec-8942-19241f1e3430 could not be found. Jun 03 13:31:13.756732 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:13.758789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d0839f99-7ed6-4984-a0a4-0741b2ffb351 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] Returning 404 to user: Instance 1becd265-d1f3-43ec-8942-19241f1e3430 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:31:13.758789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d0839f99-7ed6-4984-a0a4-0741b2ffb351 tempest-VolumesActionsTest-123373577 tempest-VolumesActionsTest-123373577-project] 10.222.0.61 "GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430" status: 404 len: 111 microversion: 2.1 time: 0.033239 Jun 03 13:31:13.758789 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 565/1037] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:13 2022] GET /compute/v2.1/servers/1becd265-d1f3-43ec-8942-19241f1e3430 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:31:14.744348 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-5e286f97-c4a4-439c-a6de-a415a4eb7841 req-62d91b57-c7f8-40ae-9d97-13026a49b97a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a50313-9112-47c6-b1f5-52c062ac8481", "tag": "2d8c994e-a998-470e-b0af-9852842f12b7"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:31:14.753551 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-5e286f97-c4a4-439c-a6de-a415a4eb7841 req-62d91b57-c7f8-40ae-9d97-13026a49b97a service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:14.754080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-5e286f97-c4a4-439c-a6de-a415a4eb7841 req-62d91b57-c7f8-40ae-9d97-13026a49b97a service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:14.765962 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-5e286f97-c4a4-439c-a6de-a415a4eb7841 req-62d91b57-c7f8-40ae-9d97-13026a49b97a service nova] Creating event network-changed:2d8c994e-a998-470e-b0af-9852842f12b7 for instance 59a50313-9112-47c6-b1f5-52c062ac8481 on hv-cinder-80135 Jun 03 13:31:14.770788 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-5e286f97-c4a4-439c-a6de-a415a4eb7841 req-62d91b57-c7f8-40ae-9d97-13026a49b97a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031131 Jun 03 13:31:14.771376 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 473/1038] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:31:21.542329 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0ec25ede-7547-4ace-8f9e-7f470ad1e859 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:21.543259 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0ec25ede-7547-4ace-8f9e-7f470ad1e859 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:21.550665 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0ec25ede-7547-4ace-8f9e-7f470ad1e859 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:21.551368 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0ec25ede-7547-4ace-8f9e-7f470ad1e859 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:21.552406 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0ec25ede-7547-4ace-8f9e-7f470ad1e859 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:21.553035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0ec25ede-7547-4ace-8f9e-7f470ad1e859 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:21.585609 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0ec25ede-7547-4ace-8f9e-7f470ad1e859 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047191 Jun 03 13:31:21.587030 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 566/1039] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:31:21 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:31:21.746923 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-815db711-5f8d-4d5b-8d9e-bafab5c5ce0c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:21.748227 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-815db711-5f8d-4d5b-8d9e-bafab5c5ce0c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:21.756229 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-815db711-5f8d-4d5b-8d9e-bafab5c5ce0c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:21.756968 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-815db711-5f8d-4d5b-8d9e-bafab5c5ce0c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:21.757767 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-815db711-5f8d-4d5b-8d9e-bafab5c5ce0c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:21.758349 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-815db711-5f8d-4d5b-8d9e-bafab5c5ce0c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:21.791922 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-815db711-5f8d-4d5b-8d9e-bafab5c5ce0c tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments/355d39fa-cf37-4705-8c80-907c01500e18" status: 200 len: 194 microversion: 2.1 time: 0.050362 Jun 03 13:31:21.792873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 474/1040] 10.222.0.61 () {58 vars in 1412 bytes} [Fri Jun 3 13:31:21 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments/355d39fa-cf37-4705-8c80-907c01500e18 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:31:21.802176 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-728d390e-a668-4984-a231-e9786457b4e5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:21.802803 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-728d390e-a668-4984-a231-e9786457b4e5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:21.809546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-728d390e-a668-4984-a231-e9786457b4e5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:21.826880 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-728d390e-a668-4984-a231-e9786457b4e5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:21.826880 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-728d390e-a668-4984-a231-e9786457b4e5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:21.826880 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-728d390e-a668-4984-a231-e9786457b4e5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:21.897972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-728d390e-a668-4984-a231-e9786457b4e5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lazy-loading 'services' on Instance uuid 58052462-e468-4d11-b88d-19551ae5f17f {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:31:22.126838 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-728d390e-a668-4984-a231-e9786457b4e5 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "DELETE /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments/355d39fa-cf37-4705-8c80-907c01500e18" status: 202 len: 0 microversion: 2.1 time: 0.328383 Jun 03 13:31:22.128071 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 567/1041] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 13:31:21 2022] DELETE /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments/355d39fa-cf37-4705-8c80-907c01500e18 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:31:24.330937 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1fcea074-8df1-4de1-92c6-bb80a3a978c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:24.331465 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-1fcea074-8df1-4de1-92c6-bb80a3a978c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:24.339829 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1fcea074-8df1-4de1-92c6-bb80a3a978c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:24.340324 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1fcea074-8df1-4de1-92c6-bb80a3a978c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:24.341269 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1fcea074-8df1-4de1-92c6-bb80a3a978c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:24.341958 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1fcea074-8df1-4de1-92c6-bb80a3a978c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:24.375414 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-1fcea074-8df1-4de1-92c6-bb80a3a978c2 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments/dfc64f47-e179-4f51-b3eb-5086d2cee7af" status: 200 len: 194 microversion: 2.1 time: 0.048518 Jun 03 13:31:24.381606 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 475/1042] 10.222.0.61 () {58 vars in 1412 bytes} [Fri Jun 3 13:31:24 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments/dfc64f47-e179-4f51-b3eb-5086d2cee7af => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:31:24.387667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-eb66e893-a026-4742-bb71-da0cfd66560d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:24.388310 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-eb66e893-a026-4742-bb71-da0cfd66560d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:24.395660 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-eb66e893-a026-4742-bb71-da0cfd66560d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:24.396126 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-eb66e893-a026-4742-bb71-da0cfd66560d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:24.396998 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-eb66e893-a026-4742-bb71-da0cfd66560d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:24.397444 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-eb66e893-a026-4742-bb71-da0cfd66560d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:24.485476 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-eb66e893-a026-4742-bb71-da0cfd66560d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lazy-loading 'services' on Instance uuid 58052462-e468-4d11-b88d-19551ae5f17f {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:31:24.712277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-eb66e893-a026-4742-bb71-da0cfd66560d tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "DELETE /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments/dfc64f47-e179-4f51-b3eb-5086d2cee7af" status: 202 len: 0 microversion: 2.1 time: 0.329104 Jun 03 13:31:24.712984 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 568/1043] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 13:31:24 2022] DELETE /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments/dfc64f47-e179-4f51-b3eb-5086d2cee7af => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 13:31:26.954236 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d68c02bd-5a79-4546-9825-0aa35f5e4738 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:26.955161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d68c02bd-5a79-4546-9825-0aa35f5e4738 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:26.962049 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d68c02bd-5a79-4546-9825-0aa35f5e4738 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:26.969215 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d68c02bd-5a79-4546-9825-0aa35f5e4738 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:26.969215 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d68c02bd-5a79-4546-9825-0aa35f5e4738 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:26.969215 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d68c02bd-5a79-4546-9825-0aa35f5e4738 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:26.994570 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d68c02bd-5a79-4546-9825-0aa35f5e4738 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043834 Jun 03 13:31:26.996032 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 476/1044] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:31:26 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:31:27.112426 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-72082702-9d7b-4f78-82f5-4c8028aa700a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:27.114181 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-72082702-9d7b-4f78-82f5-4c8028aa700a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:27.121730 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-72082702-9d7b-4f78-82f5-4c8028aa700a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:27.122184 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-72082702-9d7b-4f78-82f5-4c8028aa700a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:27.122952 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-72082702-9d7b-4f78-82f5-4c8028aa700a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:27.123388 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-72082702-9d7b-4f78-82f5-4c8028aa700a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:27.160068 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-72082702-9d7b-4f78-82f5-4c8028aa700a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052668 Jun 03 13:31:27.165983 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 569/1045] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:31:27 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:31:27.224788 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-536e1bef-dec7-4054-9b08-ed0c59d58390 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:27.225558 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-536e1bef-dec7-4054-9b08-ed0c59d58390 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:27.232704 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-536e1bef-dec7-4054-9b08-ed0c59d58390 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:27.233368 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-536e1bef-dec7-4054-9b08-ed0c59d58390 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:27.234311 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-536e1bef-dec7-4054-9b08-ed0c59d58390 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:27.234742 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-536e1bef-dec7-4054-9b08-ed0c59d58390 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:27.261547 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-536e1bef-dec7-4054-9b08-ed0c59d58390 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Going to try to terminate instance {{(pid=118178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:31:27.602411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-536e1bef-dec7-4054-9b08-ed0c59d58390 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "DELETE /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 204 len: 0 microversion: 2.1 time: 0.381039 Jun 03 13:31:27.603212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 477/1046] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:31:27 2022] DELETE /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:31:27.611491 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-20797803-77fd-4cae-adf4-54bd489ede30 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:27.612913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-20797803-77fd-4cae-adf4-54bd489ede30 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:27.620003 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-20797803-77fd-4cae-adf4-54bd489ede30 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:27.620489 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-20797803-77fd-4cae-adf4-54bd489ede30 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:27.621269 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-20797803-77fd-4cae-adf4-54bd489ede30 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:27.621712 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-20797803-77fd-4cae-adf4-54bd489ede30 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:27.626431 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:27.775916 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-20797803-77fd-4cae-adf4-54bd489ede30 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:27.785256 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-20797803-77fd-4cae-adf4-54bd489ede30 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1672 microversion: 2.1 time: 0.177734 Jun 03 13:31:27.786078 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 570/1047] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:27 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:28.803373 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e015244c-c83c-4f2d-a6a5-780da3dc5efe tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:28.804028 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e015244c-c83c-4f2d-a6a5-780da3dc5efe tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:28.812183 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e015244c-c83c-4f2d-a6a5-780da3dc5efe tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:28.812991 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e015244c-c83c-4f2d-a6a5-780da3dc5efe tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:28.814001 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e015244c-c83c-4f2d-a6a5-780da3dc5efe tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:28.814672 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e015244c-c83c-4f2d-a6a5-780da3dc5efe tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:28.998622 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e015244c-c83c-4f2d-a6a5-780da3dc5efe tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:29.008698 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e015244c-c83c-4f2d-a6a5-780da3dc5efe tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1672 microversion: 2.1 time: 0.208952 Jun 03 13:31:29.018602 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 478/1048] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:28 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1672 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:30.027202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d22061f9-83bb-43bd-977b-ed3a92014cf1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:30.028005 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d22061f9-83bb-43bd-977b-ed3a92014cf1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:30.036013 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d22061f9-83bb-43bd-977b-ed3a92014cf1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:30.036504 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d22061f9-83bb-43bd-977b-ed3a92014cf1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:30.037271 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d22061f9-83bb-43bd-977b-ed3a92014cf1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:30.037736 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d22061f9-83bb-43bd-977b-ed3a92014cf1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:30.176394 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d22061f9-83bb-43bd-977b-ed3a92014cf1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:30.185172 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d22061f9-83bb-43bd-977b-ed3a92014cf1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1672 microversion: 2.1 time: 0.163146 Jun 03 13:31:30.194876 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 571/1049] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:30 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:31.204108 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-00d1572f-fe87-4db4-aa1b-68db28614156 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:31.204737 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-00d1572f-fe87-4db4-aa1b-68db28614156 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:31.212140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-00d1572f-fe87-4db4-aa1b-68db28614156 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:31.212998 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-00d1572f-fe87-4db4-aa1b-68db28614156 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:31.214050 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-00d1572f-fe87-4db4-aa1b-68db28614156 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:31.214505 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-00d1572f-fe87-4db4-aa1b-68db28614156 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:31.333680 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-00d1572f-fe87-4db4-aa1b-68db28614156 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:31.349783 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-00d1572f-fe87-4db4-aa1b-68db28614156 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1604 microversion: 2.1 time: 0.150318 Jun 03 13:31:31.362968 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 479/1050] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:31 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:31.468043 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-eec09a3c-011c-4a33-9a25-cba090d6acdc req-117bbbd6-6552-4643-bb66-b729491df6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58052462-e468-4d11-b88d-19551ae5f17f", "name": "network-vif-deleted", "tag": "32b26cad-6b8d-4a6a-843f-1e7463db5249"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:31:31.487341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-eec09a3c-011c-4a33-9a25-cba090d6acdc req-117bbbd6-6552-4643-bb66-b729491df6f4 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:31.488478 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-eec09a3c-011c-4a33-9a25-cba090d6acdc req-117bbbd6-6552-4643-bb66-b729491df6f4 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:31.507669 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-eec09a3c-011c-4a33-9a25-cba090d6acdc req-117bbbd6-6552-4643-bb66-b729491df6f4 service nova] Creating event network-vif-deleted:32b26cad-6b8d-4a6a-843f-1e7463db5249 for instance 58052462-e468-4d11-b88d-19551ae5f17f on hv-cinder-80135 Jun 03 13:31:31.516465 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-eec09a3c-011c-4a33-9a25-cba090d6acdc req-117bbbd6-6552-4643-bb66-b729491df6f4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058067 Jun 03 13:31:31.517080 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 572/1051] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:31:32.370244 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8ee62774-2969-46cf-9783-ccbac90f927a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:32.370914 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8ee62774-2969-46cf-9783-ccbac90f927a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:32.378988 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8ee62774-2969-46cf-9783-ccbac90f927a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:32.379437 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8ee62774-2969-46cf-9783-ccbac90f927a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:32.380247 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8ee62774-2969-46cf-9783-ccbac90f927a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:32.380857 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8ee62774-2969-46cf-9783-ccbac90f927a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:32.426557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8ee62774-2969-46cf-9783-ccbac90f927a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:32.427117 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8ee62774-2969-46cf-9783-ccbac90f927a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:32.427587 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-8ee62774-2969-46cf-9783-ccbac90f927a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lazy-loading 'fault' on Instance uuid 58052462-e468-4d11-b88d-19551ae5f17f {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:31:32.482546 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8ee62774-2969-46cf-9783-ccbac90f927a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7254adba100f4453b2b9a953990dbb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4dd3e8d45a4dee9be95d8326e00edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:31:32.493737 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8ee62774-2969-46cf-9783-ccbac90f927a tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 200 len: 1327 microversion: 2.1 time: 0.127838 Jun 03 13:31:32.496615 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 480/1052] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:32 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 1327 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:31:33.514071 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-53108c1f-6184-44ee-898f-268909dda35f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:33.515407 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-53108c1f-6184-44ee-898f-268909dda35f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:33.522791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-53108c1f-6184-44ee-898f-268909dda35f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:33.523576 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-53108c1f-6184-44ee-898f-268909dda35f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:33.524829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-53108c1f-6184-44ee-898f-268909dda35f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:33.525499 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-53108c1f-6184-44ee-898f-268909dda35f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:33.540956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-53108c1f-6184-44ee-898f-268909dda35f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] HTTP exception thrown: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-53108c1f-6184-44ee-898f-268909dda35f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Request method failure captured: Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f HTTP/1.1 Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgrzbZN4t0mx0vq2U1KT3eQTx_rygGF1LofED54D_w51RAZtYADH5goX5HwD9kHOt0wQB8rm8sz88DTlJxz_Nj11klPutZfP3U5-5caYudfSCXi3W6zHiJB7AHmok71AaAiqovZ03U-84OdophGeyXiV8ZLvsV9MeFMLcT4VCiGeKpU Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 5a4dd3e8d45a4dee9be95d8326e00edf Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:31:33.542554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:31:33.544224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5a4dd3e8d45a4dee9be95d8326e00edf", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:31:33.544224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:33.544224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 5a4dd3e8d45a4dee9be95d8326e00edf Jun 03 13:31:33.544224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:33.544224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeTestJSON-773152563-project Jun 03 13:31:33.544224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:31:33.544224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:31:33.544224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 7254adba100f4453b2b9a953990dbb41 Jun 03 13:31:33.544224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeTestJSON-773152563-project Jun 03 13:31:33.544224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:31:33.544224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:33.544224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '58052462-e468-4d11-b88d-19551ae5f17f'} Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:31:33.548398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:33.549703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:33.550837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-53108c1f-6184-44ee-898f-268909dda35f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Returning 404 to user: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:31:33.550837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-53108c1f-6184-44ee-898f-268909dda35f tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 404 len: 111 microversion: 2.1 time: 0.034254 Jun 03 13:31:33.550837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 573/1053] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:33 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:31:33.553919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-118151ac-b497-4a4a-b2ad-23fe2f569ca1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '.version_select at 0x7f5bc827ae50>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:33.641757 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-118151ac-b497-4a4a-b2ad-23fe2f569ca1 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125508925" status: 202 len: 0 microversion: 2.1 time: 0.092441 Jun 03 13:31:33.642269 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 481/1054] 10.222.0.61 () {58 vars in 1220 bytes} [Fri Jun 3 13:31:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125508925 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 13:31:37.088448 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-70e740e8-451a-401e-b061-a78d9ed5ce0e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:37.092112 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-70e740e8-451a-401e-b061-a78d9ed5ce0e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:37.093444 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:37.104192 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-70e740e8-451a-401e-b061-a78d9ed5ce0e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:37.105661 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-70e740e8-451a-401e-b061-a78d9ed5ce0e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:37.107187 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-70e740e8-451a-401e-b061-a78d9ed5ce0e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:37.107639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-70e740e8-451a-401e-b061-a78d9ed5ce0e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:37.124089 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-70e740e8-451a-401e-b061-a78d9ed5ce0e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] HTTP exception thrown: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-70e740e8-451a-401e-b061-a78d9ed5ce0e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Request method failure captured: Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: DELETE /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f HTTP/1.1 Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgrzbZN4t0mx0vq2U1KT3eQTx_rygGF1LofED54D_w51RAZtYADH5goX5HwD9kHOt0wQB8rm8sz88DTlJxz_Nj11klPutZfP3U5-5caYudfSCXi3W6zHiJB7AHmok71AaAiqovZ03U-84OdophGeyXiV8ZLvsV9MeFMLcT4VCiGeKpU Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 5a4dd3e8d45a4dee9be95d8326e00edf Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:31:37.125671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:31:37.127636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5a4dd3e8d45a4dee9be95d8326e00edf", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:31:37.127636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:37.127636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 5a4dd3e8d45a4dee9be95d8326e00edf Jun 03 13:31:37.127636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:37.127636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeTestJSON-773152563-project Jun 03 13:31:37.127636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:31:37.127636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:31:37.127636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 7254adba100f4453b2b9a953990dbb41 Jun 03 13:31:37.127636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeTestJSON-773152563-project Jun 03 13:31:37.127636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:31:37.127636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:37.127636 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '58052462-e468-4d11-b88d-19551ae5f17f'} Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:31:37.128757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:37.130299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:37.131824 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-70e740e8-451a-401e-b061-a78d9ed5ce0e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Returning 404 to user: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:31:37.131824 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-70e740e8-451a-401e-b061-a78d9ed5ce0e tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "DELETE /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 404 len: 111 microversion: 2.1 time: 0.046135 Jun 03 13:31:37.131824 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 574/1055] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:31:37 2022] DELETE /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:31:37.137980 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7d7e17fa-619f-4246-8af5-1ba179d670d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:37.143925 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-7d7e17fa-619f-4246-8af5-1ba179d670d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: 58052462-e468-4d11-b88d-19551ae5f17f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:37.145410 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7d7e17fa-619f-4246-8af5-1ba179d670d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:37.145860 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7d7e17fa-619f-4246-8af5-1ba179d670d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:37.146612 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7d7e17fa-619f-4246-8af5-1ba179d670d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:37.147048 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7d7e17fa-619f-4246-8af5-1ba179d670d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:37.160322 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-7d7e17fa-619f-4246-8af5-1ba179d670d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] HTTP exception thrown: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7d7e17fa-619f-4246-8af5-1ba179d670d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Request method failure captured: Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f HTTP/1.1 Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgrzbZN4t0mx0vq2U1KT3eQTx_rygGF1LofED54D_w51RAZtYADH5goX5HwD9kHOt0wQB8rm8sz88DTlJxz_Nj11klPutZfP3U5-5caYudfSCXi3W6zHiJB7AHmok71AaAiqovZ03U-84OdophGeyXiV8ZLvsV9MeFMLcT4VCiGeKpU Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 5a4dd3e8d45a4dee9be95d8326e00edf Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:31:37.162002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:31:37.163549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5a4dd3e8d45a4dee9be95d8326e00edf", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:31:37.163549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:37.163549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 5a4dd3e8d45a4dee9be95d8326e00edf Jun 03 13:31:37.163549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:37.163549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-AttachVolumeTestJSON-773152563-project Jun 03 13:31:37.163549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:31:37.163549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:31:37.163549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 7254adba100f4453b2b9a953990dbb41 Jun 03 13:31:37.163549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-AttachVolumeTestJSON-773152563-project Jun 03 13:31:37.163549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:31:37.163549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:37.163549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '58052462-e468-4d11-b88d-19551ae5f17f'} Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:31:37.165161 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. Jun 03 13:31:37.167334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:31:37.173177 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7d7e17fa-619f-4246-8af5-1ba179d670d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Returning 404 to user: Instance 58052462-e468-4d11-b88d-19551ae5f17f could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:31:37.173177 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-7d7e17fa-619f-4246-8af5-1ba179d670d6 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f" status: 404 len: 111 microversion: 2.1 time: 0.030207 Jun 03 13:31:37.173177 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 482/1056] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:37 2022] GET /compute/v2.1/servers/58052462-e468-4d11-b88d-19551ae5f17f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:31:38.486308 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-966e3db2-90f0-4bc1-b6f0-f69994962740 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:38.486819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-966e3db2-90f0-4bc1-b6f0-f69994962740 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:38.494538 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-966e3db2-90f0-4bc1-b6f0-f69994962740 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:38.494985 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-966e3db2-90f0-4bc1-b6f0-f69994962740 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:38.495762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-966e3db2-90f0-4bc1-b6f0-f69994962740 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:38.496228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-966e3db2-90f0-4bc1-b6f0-f69994962740 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:38.510805 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-966e3db2-90f0-4bc1-b6f0-f69994962740 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] HTTP exception thrown: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-966e3db2-90f0-4bc1-b6f0-f69994962740 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Request method failure captured: Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: DELETE /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 HTTP/1.1 Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgrzbZN4t0mx0vq2U1KT3eQTx_rygGF1LofED54D_w51RAZtYADH5goX5HwD9kHOt0wQB8rm8sz88DTlJxz_Nj11klPutZfP3U5-5caYudfSCXi3W6zHiJB7AHmok71AaAiqovZ03U-84OdophGeyXiV8ZLvsV9MeFMLcT4VCiGeKpU Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 5a4dd3e8d45a4dee9be95d8326e00edf Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:31:38.512440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:31:38.514194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5a4dd3e8d45a4dee9be95d8326e00edf", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:31:38.514194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:38.514194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 5a4dd3e8d45a4dee9be95d8326e00edf Jun 03 13:31:38.514194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:38.514194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeTestJSON-773152563-project Jun 03 13:31:38.514194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:31:38.514194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:31:38.514194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 7254adba100f4453b2b9a953990dbb41 Jun 03 13:31:38.514194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeTestJSON-773152563-project Jun 03 13:31:38.514194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:31:38.514194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:31:38.514194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': 'a334af7a-c5bb-4c6e-aa37-bb7c86b838c2'} Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:31:38.515165 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:31:38.516637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:31:38.518021 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-966e3db2-90f0-4bc1-b6f0-f69994962740 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Returning 404 to user: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:31:38.518021 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-966e3db2-90f0-4bc1-b6f0-f69994962740 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 404 len: 111 microversion: 2.1 time: 0.031627 Jun 03 13:31:38.518021 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 575/1057] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:31:38 2022] DELETE /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:31:38.522577 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-baab9250-89d9-4aba-8aa5-2b39954d8c68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:31:38.523189 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-baab9250-89d9-4aba-8aa5-2b39954d8c68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] [instance: a334af7a-c5bb-4c6e-aa37-bb7c86b838c2] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:31:38.529986 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-baab9250-89d9-4aba-8aa5-2b39954d8c68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:38.530441 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-baab9250-89d9-4aba-8aa5-2b39954d8c68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:38.531239 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-baab9250-89d9-4aba-8aa5-2b39954d8c68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:31:38.531689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-baab9250-89d9-4aba-8aa5-2b39954d8c68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:31:38.545800 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-baab9250-89d9-4aba-8aa5-2b39954d8c68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] HTTP exception thrown: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-baab9250-89d9-4aba-8aa5-2b39954d8c68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Request method failure captured: Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 HTTP/1.1 Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgrzbZN4t0mx0vq2U1KT3eQTx_rygGF1LofED54D_w51RAZtYADH5goX5HwD9kHOt0wQB8rm8sz88DTlJxz_Nj11klPutZfP3U5-5caYudfSCXi3W6zHiJB7AHmok71AaAiqovZ03U-84OdophGeyXiV8ZLvsV9MeFMLcT4VCiGeKpU Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 5a4dd3e8d45a4dee9be95d8326e00edf Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:31:38.547377 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:31:38.549029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5a4dd3e8d45a4dee9be95d8326e00edf", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a4dd3e8d45a4dee9be95d8326e00edf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:31:38.549029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:38.549029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 5a4dd3e8d45a4dee9be95d8326e00edf Jun 03 13:31:38.549029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-773152563 Jun 03 13:31:38.549029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-AttachVolumeTestJSON-773152563-project Jun 03 13:31:38.549029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:31:38.549029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:31:38.549029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 7254adba100f4453b2b9a953990dbb41 Jun 03 13:31:38.549029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-AttachVolumeTestJSON-773152563-project Jun 03 13:31:38.549029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:31:38.549029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:31:38.549029 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': 'a334af7a-c5bb-4c6e-aa37-bb7c86b838c2'} Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:31:38.549837 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. Jun 03 13:31:38.552007 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:31:38.553152 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-baab9250-89d9-4aba-8aa5-2b39954d8c68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] Returning 404 to user: Instance a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:31:38.553152 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-baab9250-89d9-4aba-8aa5-2b39954d8c68 tempest-AttachVolumeTestJSON-773152563 tempest-AttachVolumeTestJSON-773152563-project] 10.222.0.61 "GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2" status: 404 len: 111 microversion: 2.1 time: 0.030135 Jun 03 13:31:38.553152 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 483/1058] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:31:38 2022] GET /compute/v2.1/servers/a334af7a-c5bb-4c6e-aa37-bb7c86b838c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:31:55.460207 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=18 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:55.670887 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-256050fe-36f8-4376-b6cd-64216ea64a83 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Action: 'create', calling method: .version_select at 0x7f5bc87ff0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1608104788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPML8KMw4ouNV9FkJtZgJyy9yiKDTNdXY5lFJ8GRc92mMIgb/PfO8FhtAFOo3U27JiA3Yghr3FV+hCQtZMAcxki/G9Xs395QsQG58fc0HLPzT3oDdHcUxwHSAmn2g6lerw=="}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:31:55.687281 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-256050fe-36f8-4376-b6cd-64216ea64a83 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Getting quotas for project 225191825c1d49c795151c7bedf35d97. Resources: {'key_pairs'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:31:55.691053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-256050fe-36f8-4376-b6cd-64216ea64a83 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Getting quotas for user a7da9a3f3e5f4eb4b1a01d33dcdb4bf2 and project 225191825c1d49c795151c7bedf35d97. Resources: {'key_pairs'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:31:55.704715 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR oslo.messaging._drivers.impl_rabbit [None req-256050fe-36f8-4376-b6cd-64216ea64a83 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [39d39d1b-3c97-485e-9147-de2fb59064b9] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 03 13:31:56.711868 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO oslo.messaging._drivers.impl_rabbit [None req-256050fe-36f8-4376-b6cd-64216ea64a83 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [39d39d1b-3c97-485e-9147-de2fb59064b9] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 48206. Jun 03 13:31:56.785188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-256050fe-36f8-4376-b6cd-64216ea64a83 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.330662 Jun 03 13:31:56.786069 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 576/1059] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 13:31:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:32:13.772852 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3251f7bb-d786-48eb-8e9c-ba225b1a4826 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:13.773770 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3251f7bb-d786-48eb-8e9c-ba225b1a4826 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:13.776003 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:13.776694 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:13.781810 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3251f7bb-d786-48eb-8e9c-ba225b1a4826 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:13.782284 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3251f7bb-d786-48eb-8e9c-ba225b1a4826 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:13.783051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3251f7bb-d786-48eb-8e9c-ba225b1a4826 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:13.783489 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3251f7bb-d786-48eb-8e9c-ba225b1a4826 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:13.813341 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3251f7bb-d786-48eb-8e9c-ba225b1a4826 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044605 Jun 03 13:32:13.813909 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 484/1060] 10.222.0.61 () {60 vars in 1342 bytes} [Fri Jun 3 13:32:13 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:13.872454 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=4 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:13.873223 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:13.877349 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-39120b43-cb3b-47af-a263-73ea968d75d7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:13.877852 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-39120b43-cb3b-47af-a263-73ea968d75d7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:13.883903 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-39120b43-cb3b-47af-a263-73ea968d75d7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:13.884919 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-39120b43-cb3b-47af-a263-73ea968d75d7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:13.885781 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-39120b43-cb3b-47af-a263-73ea968d75d7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:13.886214 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-39120b43-cb3b-47af-a263-73ea968d75d7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:13.911819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-39120b43-cb3b-47af-a263-73ea968d75d7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Going to try to terminate instance {{(pid=118179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:32:14.211867 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-39120b43-cb3b-47af-a263-73ea968d75d7 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 204 len: 0 microversion: 2.20 time: 0.340425 Jun 03 13:32:14.213248 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 577/1061] 10.222.0.61 () {60 vars in 1279 bytes} [Fri Jun 3 13:32:13 2022] DELETE /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 13:32:14.221450 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-34e42783-4e74-49a9-a5c2-dc1412c57646 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:14.221997 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-34e42783-4e74-49a9-a5c2-dc1412c57646 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:14.230271 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-34e42783-4e74-49a9-a5c2-dc1412c57646 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:14.230722 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-34e42783-4e74-49a9-a5c2-dc1412c57646 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:14.231487 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-34e42783-4e74-49a9-a5c2-dc1412c57646 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:14.231922 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-34e42783-4e74-49a9-a5c2-dc1412c57646 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:14.517224 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-34e42783-4e74-49a9-a5c2-dc1412c57646 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:14.526471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-34e42783-4e74-49a9-a5c2-dc1412c57646 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:14.527960 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-34e42783-4e74-49a9-a5c2-dc1412c57646 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:14.529138 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-34e42783-4e74-49a9-a5c2-dc1412c57646 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.311734 Jun 03 13:32:14.529691 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 485/1062] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:32:14 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:32:15.547540 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a80ba96f-aa3f-4144-91e2-626bec7b941f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:15.548266 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a80ba96f-aa3f-4144-91e2-626bec7b941f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:15.554746 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a80ba96f-aa3f-4144-91e2-626bec7b941f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:15.555205 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a80ba96f-aa3f-4144-91e2-626bec7b941f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:15.555957 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a80ba96f-aa3f-4144-91e2-626bec7b941f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:15.557100 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a80ba96f-aa3f-4144-91e2-626bec7b941f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:15.750092 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a80ba96f-aa3f-4144-91e2-626bec7b941f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:15.758527 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a80ba96f-aa3f-4144-91e2-626bec7b941f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:15.760102 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a80ba96f-aa3f-4144-91e2-626bec7b941f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:15.761297 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a80ba96f-aa3f-4144-91e2-626bec7b941f tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.218076 Jun 03 13:32:15.761854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 578/1063] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:32:15 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:32:16.779933 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6051fb36-6419-4981-9326-721d2e868e26 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:16.780766 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6051fb36-6419-4981-9326-721d2e868e26 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:16.788087 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6051fb36-6419-4981-9326-721d2e868e26 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:16.788740 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6051fb36-6419-4981-9326-721d2e868e26 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:16.789598 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6051fb36-6419-4981-9326-721d2e868e26 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:16.790137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6051fb36-6419-4981-9326-721d2e868e26 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:17.281863 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6051fb36-6419-4981-9326-721d2e868e26 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:17.291215 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6051fb36-6419-4981-9326-721d2e868e26 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:17.292950 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6051fb36-6419-4981-9326-721d2e868e26 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:17.294220 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6051fb36-6419-4981-9326-721d2e868e26 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1725 microversion: 2.20 time: 0.519196 Jun 03 13:32:17.294787 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 486/1064] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:32:16 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1725 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:32:17.502026 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-572db2e1-7b5e-4d22-bf50-03388a5f6f5f req-91ae4d2e-14d5-49de-aa4e-fb6da4009829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f51fd4a-3353-43f3-b528-c767e6b916d8", "name": "network-vif-deleted", "tag": "173fe60e-b29a-407d-93fa-37787cf955ce"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:32:17.511729 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-572db2e1-7b5e-4d22-bf50-03388a5f6f5f req-91ae4d2e-14d5-49de-aa4e-fb6da4009829 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:17.512205 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-572db2e1-7b5e-4d22-bf50-03388a5f6f5f req-91ae4d2e-14d5-49de-aa4e-fb6da4009829 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:17.524470 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-572db2e1-7b5e-4d22-bf50-03388a5f6f5f req-91ae4d2e-14d5-49de-aa4e-fb6da4009829 service nova] Creating event network-vif-deleted:173fe60e-b29a-407d-93fa-37787cf955ce for instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 on hv-cinder-80135 Jun 03 13:32:17.530296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-572db2e1-7b5e-4d22-bf50-03388a5f6f5f req-91ae4d2e-14d5-49de-aa4e-fb6da4009829 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032022 Jun 03 13:32:17.531011 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 579/1065] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:32:18.312740 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:18.313435 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:18.320757 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:18.321203 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:18.322647 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:18.323088 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:18.361705 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:18.362155 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:18.362604 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lazy-loading 'fault' on Instance uuid 9f51fd4a-3353-43f3-b528-c767e6b916d8 {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:32:18.407724 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:18.418140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:18.419854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965645bc86f44cf38c5f571406722e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab17731336f54a7eb5dfd954ddc8e688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:18.421449 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f6362f21-dd79-4554-89a6-2b8f13779a0a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 200 len: 1372 microversion: 2.20 time: 0.112385 Jun 03 13:32:18.422356 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 487/1066] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:32:18 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:32:19.445063 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d1d0bf5f-1c3f-4e0a-940d-696f0e021f1a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:19.445685 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d1d0bf5f-1c3f-4e0a-940d-696f0e021f1a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:19.452779 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d1d0bf5f-1c3f-4e0a-940d-696f0e021f1a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:19.453231 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d1d0bf5f-1c3f-4e0a-940d-696f0e021f1a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:19.453987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d1d0bf5f-1c3f-4e0a-940d-696f0e021f1a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:19.454421 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d1d0bf5f-1c3f-4e0a-940d-696f0e021f1a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:19.467766 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-d1d0bf5f-1c3f-4e0a-940d-696f0e021f1a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] HTTP exception thrown: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d1d0bf5f-1c3f-4e0a-940d-696f0e021f1a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Request method failure captured: Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 HTTP/1.1 Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr3M6Fknh-eNkB9nc5wXKNKLLE8WWCiRODkVCNRG88hg-zlGD_5DTtDIf8Ti99znTclWUm25bUsez253AZwf5dNyhILL2OeCRkc9y5BSRp2fc1zgvIkj7H6euW_gAFvw2KO36v4u3qujclASOfCH1n7RRLAqWHb5MJR-szXaZgM7Vk Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: ab17731336f54a7eb5dfd954ddc8e688 Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:32:19.469451 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:32:19.471202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ab17731336f54a7eb5dfd954ddc8e688", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:32:19.471202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:19.471202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: ab17731336f54a7eb5dfd954ddc8e688 Jun 03 13:32:19.471202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:19.471202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeShelveTestJSON-1846933890-project Jun 03 13:32:19.471202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:32:19.471202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:32:19.471202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 965645bc86f44cf38c5f571406722e32 Jun 03 13:32:19.471202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1846933890-project Jun 03 13:32:19.471202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:32:19.471202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:19.471202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '9f51fd4a-3353-43f3-b528-c767e6b916d8'} Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:32:19.472133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:19.473700 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:19.475130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d1d0bf5f-1c3f-4e0a-940d-696f0e021f1a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Returning 404 to user: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:32:19.475130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d1d0bf5f-1c3f-4e0a-940d-696f0e021f1a tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 404 len: 111 microversion: 2.20 time: 0.030729 Jun 03 13:32:19.475130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 580/1067] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:32:19 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:32:19.479865 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-db326d78-5077-4fb9-b68b-eb4ec23a488c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '.version_select at 0x7f5bc8388ee0>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:19.581350 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-db326d78-5077-4fb9-b68b-eb4ec23a488c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993816076" status: 204 len: 0 microversion: 2.20 time: 0.105253 Jun 03 13:32:19.581920 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 488/1068] 10.222.0.61 () {60 vars in 1261 bytes} [Fri Jun 3 13:32:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993816076 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 03 13:32:21.653831 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0633ca64-7fdb-4566-b1d4-8c52be300520 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:21.654399 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0633ca64-7fdb-4566-b1d4-8c52be300520 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:21.660887 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0633ca64-7fdb-4566-b1d4-8c52be300520 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:21.661362 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0633ca64-7fdb-4566-b1d4-8c52be300520 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:21.662125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0633ca64-7fdb-4566-b1d4-8c52be300520 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:21.662566 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0633ca64-7fdb-4566-b1d4-8c52be300520 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:21.676474 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-0633ca64-7fdb-4566-b1d4-8c52be300520 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] HTTP exception thrown: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0633ca64-7fdb-4566-b1d4-8c52be300520 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Request method failure captured: Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: DELETE /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 HTTP/1.1 Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr3M6Fknh-eNkB9nc5wXKNKLLE8WWCiRODkVCNRG88hg-zlGD_5DTtDIf8Ti99znTclWUm25bUsez253AZwf5dNyhILL2OeCRkc9y5BSRp2fc1zgvIkj7H6euW_gAFvw2KO36v4u3qujclASOfCH1n7RRLAqWHb5MJR-szXaZgM7Vk Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: ab17731336f54a7eb5dfd954ddc8e688 Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:32:21.678046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:32:21.679662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ab17731336f54a7eb5dfd954ddc8e688", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:32:21.679662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:21.679662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: ab17731336f54a7eb5dfd954ddc8e688 Jun 03 13:32:21.679662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:21.679662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeShelveTestJSON-1846933890-project Jun 03 13:32:21.679662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:32:21.679662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:32:21.679662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 965645bc86f44cf38c5f571406722e32 Jun 03 13:32:21.679662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1846933890-project Jun 03 13:32:21.679662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:32:21.679662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:21.679662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '9f51fd4a-3353-43f3-b528-c767e6b916d8'} Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:32:21.680632 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:21.682563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:21.684004 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0633ca64-7fdb-4566-b1d4-8c52be300520 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Returning 404 to user: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:32:21.684004 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0633ca64-7fdb-4566-b1d4-8c52be300520 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 404 len: 111 microversion: 2.20 time: 0.029791 Jun 03 13:32:21.684004 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 581/1069] 10.222.0.61 () {60 vars in 1279 bytes} [Fri Jun 3 13:32:21 2022] DELETE /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:32:21.689036 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-251cd2f5-63a5-45c9-8b4b-c8330b894d70 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:21.689671 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-251cd2f5-63a5-45c9-8b4b-c8330b894d70 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 9f51fd4a-3353-43f3-b528-c767e6b916d8] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:21.696321 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-251cd2f5-63a5-45c9-8b4b-c8330b894d70 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:21.696763 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-251cd2f5-63a5-45c9-8b4b-c8330b894d70 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:21.698137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-251cd2f5-63a5-45c9-8b4b-c8330b894d70 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:21.698569 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-251cd2f5-63a5-45c9-8b4b-c8330b894d70 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:21.711289 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-251cd2f5-63a5-45c9-8b4b-c8330b894d70 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] HTTP exception thrown: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-251cd2f5-63a5-45c9-8b4b-c8330b894d70 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Request method failure captured: Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 HTTP/1.1 Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgr3M6Fknh-eNkB9nc5wXKNKLLE8WWCiRODkVCNRG88hg-zlGD_5DTtDIf8Ti99znTclWUm25bUsez253AZwf5dNyhILL2OeCRkc9y5BSRp2fc1zgvIkj7H6euW_gAFvw2KO36v4u3qujclASOfCH1n7RRLAqWHb5MJR-szXaZgM7Vk Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: ab17731336f54a7eb5dfd954ddc8e688 Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:32:21.713468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:32:21.715113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ab17731336f54a7eb5dfd954ddc8e688", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:32:21.715113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:21.715113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: ab17731336f54a7eb5dfd954ddc8e688 Jun 03 13:32:21.715113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:21.715113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-AttachVolumeShelveTestJSON-1846933890-project Jun 03 13:32:21.715113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:32:21.715113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:32:21.715113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 965645bc86f44cf38c5f571406722e32 Jun 03 13:32:21.715113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1846933890-project Jun 03 13:32:21.715113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:32:21.715113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:21.715113 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '9f51fd4a-3353-43f3-b528-c767e6b916d8'} Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:32:21.715902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. Jun 03 13:32:21.717137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:32:21.718204 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-251cd2f5-63a5-45c9-8b4b-c8330b894d70 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Returning 404 to user: Instance 9f51fd4a-3353-43f3-b528-c767e6b916d8 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:32:21.718204 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-251cd2f5-63a5-45c9-8b4b-c8330b894d70 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8" status: 404 len: 111 microversion: 2.20 time: 0.030267 Jun 03 13:32:21.718204 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 489/1070] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:32:21 2022] GET /compute/v2.1/servers/9f51fd4a-3353-43f3-b528-c767e6b916d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:32:23.027720 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-98c49a33-cbb6-46b4-958a-3b5ae83decb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:23.028321 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-98c49a33-cbb6-46b4-958a-3b5ae83decb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:23.034853 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-98c49a33-cbb6-46b4-958a-3b5ae83decb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:23.035300 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-98c49a33-cbb6-46b4-958a-3b5ae83decb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:23.036237 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-98c49a33-cbb6-46b4-958a-3b5ae83decb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:23.036679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-98c49a33-cbb6-46b4-958a-3b5ae83decb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:23.050946 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-98c49a33-cbb6-46b4-958a-3b5ae83decb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] HTTP exception thrown: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-98c49a33-cbb6-46b4-958a-3b5ae83decb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Request method failure captured: Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: DELETE /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 HTTP/1.1 Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr3M6Fknh-eNkB9nc5wXKNKLLE8WWCiRODkVCNRG88hg-zlGD_5DTtDIf8Ti99znTclWUm25bUsez253AZwf5dNyhILL2OeCRkc9y5BSRp2fc1zgvIkj7H6euW_gAFvw2KO36v4u3qujclASOfCH1n7RRLAqWHb5MJR-szXaZgM7Vk Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: ab17731336f54a7eb5dfd954ddc8e688 Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:32:23.052536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:32:23.053918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ab17731336f54a7eb5dfd954ddc8e688", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:32:23.053918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:23.053918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: ab17731336f54a7eb5dfd954ddc8e688 Jun 03 13:32:23.053918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:23.053918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeShelveTestJSON-1846933890-project Jun 03 13:32:23.053918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:32:23.053918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:32:23.053918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 965645bc86f44cf38c5f571406722e32 Jun 03 13:32:23.053918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1846933890-project Jun 03 13:32:23.053918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:32:23.053918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:32:23.053918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '8f119f5f-b6ed-45a0-a780-b1e037c96cc1'} Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:32:23.058197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:32:23.059671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:32:23.061190 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-98c49a33-cbb6-46b4-958a-3b5ae83decb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Returning 404 to user: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:32:23.061190 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-98c49a33-cbb6-46b4-958a-3b5ae83decb4 tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 404 len: 111 microversion: 2.20 time: 0.030989 Jun 03 13:32:23.061190 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 582/1071] 10.222.0.61 () {60 vars in 1279 bytes} [Fri Jun 3 13:32:23 2022] DELETE /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:32:23.063043 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6a94d048-2283-4c3c-9917-9c17fd56309c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:23.063654 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6a94d048-2283-4c3c-9917-9c17fd56309c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] [instance: 8f119f5f-b6ed-45a0-a780-b1e037c96cc1] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:23.070011 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6a94d048-2283-4c3c-9917-9c17fd56309c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:23.070462 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6a94d048-2283-4c3c-9917-9c17fd56309c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:23.071215 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6a94d048-2283-4c3c-9917-9c17fd56309c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:23.071734 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6a94d048-2283-4c3c-9917-9c17fd56309c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:23.087423 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-6a94d048-2283-4c3c-9917-9c17fd56309c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] HTTP exception thrown: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6a94d048-2283-4c3c-9917-9c17fd56309c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Request method failure captured: Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 HTTP/1.1 Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgr3M6Fknh-eNkB9nc5wXKNKLLE8WWCiRODkVCNRG88hg-zlGD_5DTtDIf8Ti99znTclWUm25bUsez253AZwf5dNyhILL2OeCRkc9y5BSRp2fc1zgvIkj7H6euW_gAFvw2KO36v4u3qujclASOfCH1n7RRLAqWHb5MJR-szXaZgM7Vk Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: ab17731336f54a7eb5dfd954ddc8e688 Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:32:23.089115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:32:23.090827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ab17731336f54a7eb5dfd954ddc8e688", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab17731336f54a7eb5dfd954ddc8e688"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:32:23.090827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:23.090827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: ab17731336f54a7eb5dfd954ddc8e688 Jun 03 13:32:23.090827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1846933890 Jun 03 13:32:23.090827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-AttachVolumeShelveTestJSON-1846933890-project Jun 03 13:32:23.090827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:32:23.090827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:32:23.090827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 965645bc86f44cf38c5f571406722e32 Jun 03 13:32:23.090827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1846933890-project Jun 03 13:32:23.090827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:32:23.090827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:32:23.090827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '8f119f5f-b6ed-45a0-a780-b1e037c96cc1'} Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:32:23.091868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. Jun 03 13:32:23.093534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:32:23.096005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6a94d048-2283-4c3c-9917-9c17fd56309c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] Returning 404 to user: Instance 8f119f5f-b6ed-45a0-a780-b1e037c96cc1 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:32:23.096005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6a94d048-2283-4c3c-9917-9c17fd56309c tempest-AttachVolumeShelveTestJSON-1846933890 tempest-AttachVolumeShelveTestJSON-1846933890-project] 10.222.0.61 "GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1" status: 404 len: 111 microversion: 2.20 time: 0.031404 Jun 03 13:32:23.096005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 490/1072] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 13:32:23 2022] GET /compute/v2.1/servers/8f119f5f-b6ed-45a0-a780-b1e037c96cc1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:32:25.429385 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-795452679", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1608104788", "security_groups": [{"name": "tempest-secgroup-smoke-696385968"}], "networks": [{"uuid": "9fee9f94-a2f9-4fb2-9044-c6f0a34b0c03"}], "block_device_mapping_v2": [{"uuid": "d09ce5d1-85c8-4f7b-a726-77690cd3049c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:32:25.548290 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.network.neutron [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] validate_networks() for [('9fee9f94-a2f9-4fb2-9044-c6f0a34b0c03', None, None, None, None, None)] {{(pid=118179) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:32:26.078791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Flavor limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:32:26.078791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Image limits 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:32:26.078791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Flavor pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:32:26.078791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Image pref 0:0:0 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:32:26.079191 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.virt.hardware [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:32:26.088829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:26.091079 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:26.092074 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:26.092698 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:26.111974 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Getting quotas for project 225191825c1d49c795151c7bedf35d97. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:32:26.117805 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.quota [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Getting quotas for user a7da9a3f3e5f4eb4b1a01d33dcdb4bf2 and project 225191825c1d49c795151c7bedf35d97. Resources: {'ram', 'cores', 'instances'} {{(pid=118179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:32:26.201716 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Going to run 1 instances... {{(pid=118179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:32:26.203808 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d09ce5d1-85c8-4f7b-a726-77690cd3049c',volume_size=None,volume_type=None)] {{(pid=118179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:32:26.650718 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b6ca6439-0eb0-4441-9bb8-9f443e34a532 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.224992 Jun 03 13:32:26.652078 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 583/1073] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:32:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 13:32:26.662970 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a52902ae-3b1b-4e95-94c3-707e49d0fd1f tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:26.663673 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a52902ae-3b1b-4e95-94c3-707e49d0fd1f tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:26.737944 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a52902ae-3b1b-4e95-94c3-707e49d0fd1f tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:26.746328 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a52902ae-3b1b-4e95-94c3-707e49d0fd1f tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1088 microversion: 2.1 time: 0.087734 Jun 03 13:32:26.746903 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 491/1074] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:26 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1088 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:27.763891 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-18073c30-9e4a-4a1d-81f1-2316d7b0f237 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:27.765320 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-18073c30-9e4a-4a1d-81f1-2316d7b0f237 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:27.836220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-18073c30-9e4a-4a1d-81f1-2316d7b0f237 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:27.844248 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-18073c30-9e4a-4a1d-81f1-2316d7b0f237 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1088 microversion: 2.1 time: 0.084707 Jun 03 13:32:27.844756 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 584/1075] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:27 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:32:28.860808 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-fc19684f-6e67-48bc-a246-bd1d96100db0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:28.861500 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-fc19684f-6e67-48bc-a246-bd1d96100db0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:28.869648 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fc19684f-6e67-48bc-a246-bd1d96100db0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:28.870140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fc19684f-6e67-48bc-a246-bd1d96100db0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:28.870923 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fc19684f-6e67-48bc-a246-bd1d96100db0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:28.871367 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fc19684f-6e67-48bc-a246-bd1d96100db0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:28.958355 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-fc19684f-6e67-48bc-a246-bd1d96100db0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:28.967102 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-fc19684f-6e67-48bc-a246-bd1d96100db0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1186 microversion: 2.1 time: 0.110177 Jun 03 13:32:28.967677 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 492/1076] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:28 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1186 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:29.986982 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-96faa7fb-4a0b-410a-942e-82a8fe52efca tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:29.988274 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-96faa7fb-4a0b-410a-942e-82a8fe52efca tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:29.995104 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-96faa7fb-4a0b-410a-942e-82a8fe52efca tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:30.000730 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-96faa7fb-4a0b-410a-942e-82a8fe52efca tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:30.000730 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-96faa7fb-4a0b-410a-942e-82a8fe52efca tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:30.000730 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-96faa7fb-4a0b-410a-942e-82a8fe52efca tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:30.063282 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-96faa7fb-4a0b-410a-942e-82a8fe52efca tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:30.072528 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-96faa7fb-4a0b-410a-942e-82a8fe52efca tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1204 microversion: 2.1 time: 0.090202 Jun 03 13:32:30.076355 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 585/1077] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:29 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:31.096426 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b5d3f81d-0da0-4131-89e7-7d08c553c632 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:31.099505 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b5d3f81d-0da0-4131-89e7-7d08c553c632 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:31.112119 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b5d3f81d-0da0-4131-89e7-7d08c553c632 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:31.112457 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b5d3f81d-0da0-4131-89e7-7d08c553c632 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:31.113249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b5d3f81d-0da0-4131-89e7-7d08c553c632 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:31.113687 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b5d3f81d-0da0-4131-89e7-7d08c553c632 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:31.362879 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b5d3f81d-0da0-4131-89e7-7d08c553c632 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:31.372457 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b5d3f81d-0da0-4131-89e7-7d08c553c632 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.282487 Jun 03 13:32:31.382574 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 493/1078] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:31 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:31.825440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-91391315-4271-4b19-a551-403d9c3c83e3 req-cb19b71a-b355-44a4-a053-bcdbc53339c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e599e23-8550-45f3-aa57-3a875f922883", "tag": "14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:32:31.835817 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-91391315-4271-4b19-a551-403d9c3c83e3 req-cb19b71a-b355-44a4-a053-bcdbc53339c7 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:31.837640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-91391315-4271-4b19-a551-403d9c3c83e3 req-cb19b71a-b355-44a4-a053-bcdbc53339c7 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:31.850066 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-91391315-4271-4b19-a551-403d9c3c83e3 req-cb19b71a-b355-44a4-a053-bcdbc53339c7 service nova] Creating event network-changed:14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c for instance 5e599e23-8550-45f3-aa57-3a875f922883 on hv-cinder-80135 Jun 03 13:32:31.856539 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-91391315-4271-4b19-a551-403d9c3c83e3 req-cb19b71a-b355-44a4-a053-bcdbc53339c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034875 Jun 03 13:32:31.857332 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 586/1079] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:32:32.390885 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b1358199-b43e-4b0b-ab1c-cd0ae74e912e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:32.392455 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b1358199-b43e-4b0b-ab1c-cd0ae74e912e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:32.399381 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b1358199-b43e-4b0b-ab1c-cd0ae74e912e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:32.399891 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b1358199-b43e-4b0b-ab1c-cd0ae74e912e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:32.401472 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b1358199-b43e-4b0b-ab1c-cd0ae74e912e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:32.401974 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b1358199-b43e-4b0b-ab1c-cd0ae74e912e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:32.674880 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b1358199-b43e-4b0b-ab1c-cd0ae74e912e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:32.690512 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b1358199-b43e-4b0b-ab1c-cd0ae74e912e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.303324 Jun 03 13:32:32.691671 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 494/1080] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:32 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:33.710769 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-084ca2c7-b840-419c-b54e-d9f2d0c42418 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:33.711605 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-084ca2c7-b840-419c-b54e-d9f2d0c42418 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:33.718765 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-084ca2c7-b840-419c-b54e-d9f2d0c42418 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:33.719225 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-084ca2c7-b840-419c-b54e-d9f2d0c42418 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:33.720015 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-084ca2c7-b840-419c-b54e-d9f2d0c42418 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:33.720485 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-084ca2c7-b840-419c-b54e-d9f2d0c42418 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:33.866837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-084ca2c7-b840-419c-b54e-d9f2d0c42418 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:33.874660 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-084ca2c7-b840-419c-b54e-d9f2d0c42418 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.168588 Jun 03 13:32:33.875529 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 587/1081] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:33 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:34.891462 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8b74b5ac-2afe-4645-9eb6-019bf5000f82 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:34.894668 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8b74b5ac-2afe-4645-9eb6-019bf5000f82 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:34.898684 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8b74b5ac-2afe-4645-9eb6-019bf5000f82 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:34.899134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8b74b5ac-2afe-4645-9eb6-019bf5000f82 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:34.900791 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8b74b5ac-2afe-4645-9eb6-019bf5000f82 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:34.901240 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8b74b5ac-2afe-4645-9eb6-019bf5000f82 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:35.037220 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8b74b5ac-2afe-4645-9eb6-019bf5000f82 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:35.045091 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8b74b5ac-2afe-4645-9eb6-019bf5000f82 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.157600 Jun 03 13:32:35.045764 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 495/1082] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:34 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:36.062848 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-68414a4f-e080-4bc7-bd3c-52350ba60351 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:36.063458 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-68414a4f-e080-4bc7-bd3c-52350ba60351 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:36.069896 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-68414a4f-e080-4bc7-bd3c-52350ba60351 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:36.070338 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-68414a4f-e080-4bc7-bd3c-52350ba60351 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:36.071093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-68414a4f-e080-4bc7-bd3c-52350ba60351 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:36.072218 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-68414a4f-e080-4bc7-bd3c-52350ba60351 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:36.103221 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:36.202417 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-68414a4f-e080-4bc7-bd3c-52350ba60351 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:36.209779 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-68414a4f-e080-4bc7-bd3c-52350ba60351 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.150823 Jun 03 13:32:36.210341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 588/1083] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:36 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:37.226910 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-654fefcc-3ef1-45b7-ae8d-4910e985d325 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:37.227523 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-654fefcc-3ef1-45b7-ae8d-4910e985d325 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:37.229974 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:37.234798 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-654fefcc-3ef1-45b7-ae8d-4910e985d325 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:37.235249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-654fefcc-3ef1-45b7-ae8d-4910e985d325 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:37.236018 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-654fefcc-3ef1-45b7-ae8d-4910e985d325 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:37.236496 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-654fefcc-3ef1-45b7-ae8d-4910e985d325 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:37.371102 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-654fefcc-3ef1-45b7-ae8d-4910e985d325 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:37.379287 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-654fefcc-3ef1-45b7-ae8d-4910e985d325 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.156668 Jun 03 13:32:37.379868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 496/1084] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:37 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:38.396941 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b8692273-309c-4797-b49c-5e817bb1887a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:38.397546 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b8692273-309c-4797-b49c-5e817bb1887a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:38.400341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=8 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:38.405128 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b8692273-309c-4797-b49c-5e817bb1887a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:38.405587 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b8692273-309c-4797-b49c-5e817bb1887a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:38.406351 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b8692273-309c-4797-b49c-5e817bb1887a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:38.406790 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b8692273-309c-4797-b49c-5e817bb1887a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:38.542045 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b8692273-309c-4797-b49c-5e817bb1887a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:38.549497 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b8692273-309c-4797-b49c-5e817bb1887a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.156460 Jun 03 13:32:38.550060 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 589/1085] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:38 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:39.565927 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-08b92c1e-6d3b-4313-a760-94cd817b1695 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:39.566460 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-08b92c1e-6d3b-4313-a760-94cd817b1695 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:39.573334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-08b92c1e-6d3b-4313-a760-94cd817b1695 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:39.573786 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-08b92c1e-6d3b-4313-a760-94cd817b1695 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:39.574554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-08b92c1e-6d3b-4313-a760-94cd817b1695 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:39.574993 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-08b92c1e-6d3b-4313-a760-94cd817b1695 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:39.740222 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-08b92c1e-6d3b-4313-a760-94cd817b1695 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:39.748050 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-08b92c1e-6d3b-4313-a760-94cd817b1695 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.186083 Jun 03 13:32:39.748732 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 497/1086] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:39 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:40.770595 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-84883bb6-49ff-4e8b-9eb4-16de9c505958 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:40.771849 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-84883bb6-49ff-4e8b-9eb4-16de9c505958 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:40.779736 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-84883bb6-49ff-4e8b-9eb4-16de9c505958 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:40.780201 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-84883bb6-49ff-4e8b-9eb4-16de9c505958 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:40.781145 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-84883bb6-49ff-4e8b-9eb4-16de9c505958 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:40.781574 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-84883bb6-49ff-4e8b-9eb4-16de9c505958 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:41.171958 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-84883bb6-49ff-4e8b-9eb4-16de9c505958 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:41.179500 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-84883bb6-49ff-4e8b-9eb4-16de9c505958 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.417517 Jun 03 13:32:41.180065 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 590/1087] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:40 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:42.196464 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-2e37467a-643a-4d21-b5a9-88eb5c8aab23 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:42.197119 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-2e37467a-643a-4d21-b5a9-88eb5c8aab23 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:42.203564 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2e37467a-643a-4d21-b5a9-88eb5c8aab23 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:42.204000 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2e37467a-643a-4d21-b5a9-88eb5c8aab23 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:42.204792 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2e37467a-643a-4d21-b5a9-88eb5c8aab23 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:42.205223 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-2e37467a-643a-4d21-b5a9-88eb5c8aab23 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:42.337331 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-2e37467a-643a-4d21-b5a9-88eb5c8aab23 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:42.344808 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-2e37467a-643a-4d21-b5a9-88eb5c8aab23 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.152400 Jun 03 13:32:42.345454 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 498/1088] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:42 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:43.362097 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-191b94f5-56b9-420f-8658-b70634c723ae tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:43.362774 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-191b94f5-56b9-420f-8658-b70634c723ae tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:43.369842 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-191b94f5-56b9-420f-8658-b70634c723ae tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:43.370221 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-191b94f5-56b9-420f-8658-b70634c723ae tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:43.370971 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-191b94f5-56b9-420f-8658-b70634c723ae tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:43.371417 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-191b94f5-56b9-420f-8658-b70634c723ae tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:43.513046 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-191b94f5-56b9-420f-8658-b70634c723ae tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:43.524186 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-191b94f5-56b9-420f-8658-b70634c723ae tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.165956 Jun 03 13:32:43.528185 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 591/1089] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:43 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:43.624457 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-722626501", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-453693398", "security_groups": [{"name": "tempest-secgroup-smoke-921469941"}], "block_device_mapping_v2": [{"uuid": "85d43b52-09a7-48e3-a117-bed15fd89d46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2487575-f377-4558-bc42-3d6e3c396511"}]}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:32:43.738789 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.network.neutron [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] validate_networks() for [('f2487575-f377-4558-bc42-3d6e3c396511', None, None, None, None, None)] {{(pid=118178) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:32:44.119765 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Flavor limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:32:44.123623 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Image limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:32:44.123623 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Flavor pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:32:44.123623 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Image pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:32:44.123623 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:32:44.130706 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:44.131146 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:44.131941 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:44.132399 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:44.148672 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Getting quotas for project c880a17cc9844081bee38006d5b92f86. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:32:44.153214 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Getting quotas for user 77c56945d1d74a1eaa5e0c8f9e43f086 and project c880a17cc9844081bee38006d5b92f86. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:32:44.214300 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Going to run 1 instances... {{(pid=118178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:32:44.216409 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='85d43b52-09a7-48e3-a117-bed15fd89d46',volume_size=None,volume_type=None)] {{(pid=118178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:32:44.541773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-fbb3d724-1d2b-4d18-9944-cc2ced8b8061 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:44.547412 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-fbb3d724-1d2b-4d18-9944-cc2ced8b8061 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:44.547948 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:44.550060 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fbb3d724-1d2b-4d18-9944-cc2ced8b8061 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:44.550520 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fbb3d724-1d2b-4d18-9944-cc2ced8b8061 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:44.551290 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fbb3d724-1d2b-4d18-9944-cc2ced8b8061 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:44.551729 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fbb3d724-1d2b-4d18-9944-cc2ced8b8061 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:44.554726 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:44.686186 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-944921c9-c1c6-4f10-a54f-ccce0aa1c8cf tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.062594 Jun 03 13:32:44.692427 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 499/1090] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:32:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:32:44.698317 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a13de072-654c-40e1-9b47-9ea56dfe3834 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:44.698933 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a13de072-654c-40e1-9b47-9ea56dfe3834 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:44.729028 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fbb3d724-1d2b-4d18-9944-cc2ced8b8061 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:44.736602 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-fbb3d724-1d2b-4d18-9944-cc2ced8b8061 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.199276 Jun 03 13:32:44.745360 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 592/1091] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:44 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:44.781696 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a13de072-654c-40e1-9b47-9ea56dfe3834 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:44.795411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a13de072-654c-40e1-9b47-9ea56dfe3834 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1093 microversion: 2.1 time: 0.096770 Jun 03 13:32:44.795411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 500/1092] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:44 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1093 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:45.762423 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ed0ed031-3c99-4dc5-b173-c88ffba8db8b tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:45.763123 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ed0ed031-3c99-4dc5-b173-c88ffba8db8b tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:45.770642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ed0ed031-3c99-4dc5-b173-c88ffba8db8b tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:45.771487 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ed0ed031-3c99-4dc5-b173-c88ffba8db8b tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:45.774292 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ed0ed031-3c99-4dc5-b173-c88ffba8db8b tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:45.776251 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ed0ed031-3c99-4dc5-b173-c88ffba8db8b tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:45.826811 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-514cea16-dad2-403a-a96c-4a59d3dfa9af tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:45.828464 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-514cea16-dad2-403a-a96c-4a59d3dfa9af tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:45.843883 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-514cea16-dad2-403a-a96c-4a59d3dfa9af tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:45.845147 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-514cea16-dad2-403a-a96c-4a59d3dfa9af tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:45.846797 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-514cea16-dad2-403a-a96c-4a59d3dfa9af tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:45.848003 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-514cea16-dad2-403a-a96c-4a59d3dfa9af tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:45.893448 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=75 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:45.917108 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ed0ed031-3c99-4dc5-b173-c88ffba8db8b tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:45.925840 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ed0ed031-3c99-4dc5-b173-c88ffba8db8b tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.167403 Jun 03 13:32:45.926703 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 593/1093] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:45 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:45.960429 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-514cea16-dad2-403a-a96c-4a59d3dfa9af tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:45.969510 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-514cea16-dad2-403a-a96c-4a59d3dfa9af tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1143 microversion: 2.1 time: 0.163901 Jun 03 13:32:45.970633 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 501/1094] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:45 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1143 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:46.946164 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0e286410-ed7a-4fd5-a5e8-a967ae8fcfa3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:46.946889 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0e286410-ed7a-4fd5-a5e8-a967ae8fcfa3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:46.954645 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0e286410-ed7a-4fd5-a5e8-a967ae8fcfa3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:46.955053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0e286410-ed7a-4fd5-a5e8-a967ae8fcfa3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:46.955841 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0e286410-ed7a-4fd5-a5e8-a967ae8fcfa3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:46.956317 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0e286410-ed7a-4fd5-a5e8-a967ae8fcfa3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:46.986507 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0a3f4b27-10a6-43f8-b06d-02f0f2b20cff tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:46.987796 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0a3f4b27-10a6-43f8-b06d-02f0f2b20cff tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:46.992447 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:47.000723 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0a3f4b27-10a6-43f8-b06d-02f0f2b20cff tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:47.001185 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0a3f4b27-10a6-43f8-b06d-02f0f2b20cff tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:47.002126 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0a3f4b27-10a6-43f8-b06d-02f0f2b20cff tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:47.002576 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0a3f4b27-10a6-43f8-b06d-02f0f2b20cff tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:47.069868 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0a3f4b27-10a6-43f8-b06d-02f0f2b20cff tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:47.077720 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0a3f4b27-10a6-43f8-b06d-02f0f2b20cff tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1199 microversion: 2.1 time: 0.095410 Jun 03 13:32:47.078364 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 502/1095] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:46 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:32:47.104799 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0e286410-ed7a-4fd5-a5e8-a967ae8fcfa3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:47.112515 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0e286410-ed7a-4fd5-a5e8-a967ae8fcfa3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.170934 Jun 03 13:32:47.113087 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 594/1096] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:46 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:48.081825 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-e7ac71f0-d800-45ba-897e-252d1b6e37d1 req-08a918d0-8eba-4d62-b957-db1e49aba722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e599e23-8550-45f3-aa57-3a875f922883", "name": "network-vif-plugged", "status": "completed", "tag": "14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:32:48.096451 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-e7ac71f0-d800-45ba-897e-252d1b6e37d1 req-08a918d0-8eba-4d62-b957-db1e49aba722 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:48.096950 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f556692e-6358-4940-8c97-ed061029005d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:48.097592 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-e7ac71f0-d800-45ba-897e-252d1b6e37d1 req-08a918d0-8eba-4d62-b957-db1e49aba722 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:48.099762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f556692e-6358-4940-8c97-ed061029005d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:48.108913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f556692e-6358-4940-8c97-ed061029005d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:48.109559 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f556692e-6358-4940-8c97-ed061029005d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:48.110542 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f556692e-6358-4940-8c97-ed061029005d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:48.111036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f556692e-6358-4940-8c97-ed061029005d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:48.112765 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-e7ac71f0-d800-45ba-897e-252d1b6e37d1 req-08a918d0-8eba-4d62-b957-db1e49aba722 service nova] Creating event network-vif-plugged:14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c for instance 5e599e23-8550-45f3-aa57-3a875f922883 on hv-cinder-80135 Jun 03 13:32:48.119352 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-e7ac71f0-d800-45ba-897e-252d1b6e37d1 req-08a918d0-8eba-4d62-b957-db1e49aba722 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042054 Jun 03 13:32:48.119991 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 503/1097] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:32:48.130736 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f99fb58f-2221-4211-abcb-80e7d6bf481e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:48.131480 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f99fb58f-2221-4211-abcb-80e7d6bf481e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:48.138479 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f99fb58f-2221-4211-abcb-80e7d6bf481e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:48.138952 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f99fb58f-2221-4211-abcb-80e7d6bf481e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:48.139776 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f99fb58f-2221-4211-abcb-80e7d6bf481e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:48.140432 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f99fb58f-2221-4211-abcb-80e7d6bf481e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:48.249873 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-f556692e-6358-4940-8c97-ed061029005d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:48.259954 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f556692e-6358-4940-8c97-ed061029005d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1276 microversion: 2.1 time: 0.168626 Jun 03 13:32:48.260777 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 595/1098] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:48 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:32:48.288114 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f99fb58f-2221-4211-abcb-80e7d6bf481e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:48.296114 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f99fb58f-2221-4211-abcb-80e7d6bf481e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.169832 Jun 03 13:32:48.296724 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 504/1099] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:48 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:32:49.283263 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d0369ac0-7ea8-44eb-b022-d3684fd8584c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:49.283263 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d0369ac0-7ea8-44eb-b022-d3684fd8584c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:49.284757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d0369ac0-7ea8-44eb-b022-d3684fd8584c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:49.285209 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d0369ac0-7ea8-44eb-b022-d3684fd8584c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:49.285971 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d0369ac0-7ea8-44eb-b022-d3684fd8584c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:49.286407 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d0369ac0-7ea8-44eb-b022-d3684fd8584c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:49.319275 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f64d22e4-8c0f-4f97-9217-cb24a1e6f402 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:49.319907 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f64d22e4-8c0f-4f97-9217-cb24a1e6f402 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:49.338992 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f64d22e4-8c0f-4f97-9217-cb24a1e6f402 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:49.340186 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f64d22e4-8c0f-4f97-9217-cb24a1e6f402 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:49.341049 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f64d22e4-8c0f-4f97-9217-cb24a1e6f402 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:49.343761 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f64d22e4-8c0f-4f97-9217-cb24a1e6f402 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:49.464445 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d0369ac0-7ea8-44eb-b022-d3684fd8584c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:49.472471 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d0369ac0-7ea8-44eb-b022-d3684fd8584c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1276 microversion: 2.1 time: 0.199047 Jun 03 13:32:49.473377 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 596/1100] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:49 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:49.485194 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-4e605d5c-c730-45b5-bbe5-925ec6a352bd req-4f9f4eef-f62b-4fd0-b837-d2de7a432345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8652e1dc-fa91-404d-9748-44c988f06a51", "tag": "62634e0e-67f6-48f8-9f4a-af413bba9c4e"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:32:49.500397 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-4e605d5c-c730-45b5-bbe5-925ec6a352bd req-4f9f4eef-f62b-4fd0-b837-d2de7a432345 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:49.500841 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-4e605d5c-c730-45b5-bbe5-925ec6a352bd req-4f9f4eef-f62b-4fd0-b837-d2de7a432345 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:49.513146 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-4e605d5c-c730-45b5-bbe5-925ec6a352bd req-4f9f4eef-f62b-4fd0-b837-d2de7a432345 service nova] Creating event network-changed:62634e0e-67f6-48f8-9f4a-af413bba9c4e for instance 8652e1dc-fa91-404d-9748-44c988f06a51 on hv-cinder-80135 Jun 03 13:32:49.521021 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-4e605d5c-c730-45b5-bbe5-925ec6a352bd req-4f9f4eef-f62b-4fd0-b837-d2de7a432345 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044049 Jun 03 13:32:49.521021 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 597/1101] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:32:49.538603 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f64d22e4-8c0f-4f97-9217-cb24a1e6f402 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:49.547154 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f64d22e4-8c0f-4f97-9217-cb24a1e6f402 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.237697 Jun 03 13:32:49.547879 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 505/1102] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:49 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:50.490603 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e7840258-6cc5-4aae-a7b4-da003b480393 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:50.491333 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e7840258-6cc5-4aae-a7b4-da003b480393 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:50.498382 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e7840258-6cc5-4aae-a7b4-da003b480393 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:50.499150 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e7840258-6cc5-4aae-a7b4-da003b480393 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:50.500088 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e7840258-6cc5-4aae-a7b4-da003b480393 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:50.500552 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e7840258-6cc5-4aae-a7b4-da003b480393 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:50.563708 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-18e032cb-7ab4-407b-a30b-1ab996cfa451 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:50.564621 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-18e032cb-7ab4-407b-a30b-1ab996cfa451 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:50.590931 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-18e032cb-7ab4-407b-a30b-1ab996cfa451 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:50.593589 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-18e032cb-7ab4-407b-a30b-1ab996cfa451 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:50.594476 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-18e032cb-7ab4-407b-a30b-1ab996cfa451 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:50.596065 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-18e032cb-7ab4-407b-a30b-1ab996cfa451 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:50.786454 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e7840258-6cc5-4aae-a7b4-da003b480393 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:50.797739 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e7840258-6cc5-4aae-a7b4-da003b480393 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.311974 Jun 03 13:32:50.799126 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 598/1103] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:50 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:50.874925 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-18e032cb-7ab4-407b-a30b-1ab996cfa451 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:50.888651 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-18e032cb-7ab4-407b-a30b-1ab996cfa451 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1259 microversion: 2.1 time: 0.328989 Jun 03 13:32:50.889541 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 506/1104] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:50 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1259 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:51.816125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-bb5f11f0-52af-4352-840c-332810f5e427 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:51.816854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-bb5f11f0-52af-4352-840c-332810f5e427 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:51.824349 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bb5f11f0-52af-4352-840c-332810f5e427 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:51.824885 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bb5f11f0-52af-4352-840c-332810f5e427 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:51.825733 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bb5f11f0-52af-4352-840c-332810f5e427 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:51.826266 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bb5f11f0-52af-4352-840c-332810f5e427 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:51.905806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1b9b9793-f303-4ffd-8450-8d23ea4f8f7a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:51.906421 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-1b9b9793-f303-4ffd-8450-8d23ea4f8f7a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:51.913276 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1b9b9793-f303-4ffd-8450-8d23ea4f8f7a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:51.913726 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1b9b9793-f303-4ffd-8450-8d23ea4f8f7a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:51.914677 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1b9b9793-f303-4ffd-8450-8d23ea4f8f7a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:51.915997 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1b9b9793-f303-4ffd-8450-8d23ea4f8f7a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:51.978426 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-bb5f11f0-52af-4352-840c-332810f5e427 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:51.986367 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-bb5f11f0-52af-4352-840c-332810f5e427 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.174052 Jun 03 13:32:51.987674 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 599/1105] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:51 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:52.066266 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-1b9b9793-f303-4ffd-8450-8d23ea4f8f7a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:52.075511 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-1b9b9793-f303-4ffd-8450-8d23ea4f8f7a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1442 microversion: 2.1 time: 0.173548 Jun 03 13:32:52.078207 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 507/1106] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:51 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1442 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:32:52.094133 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0a0a74c9-4b4f-4b33-970b-cc95e23f0a2c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:52.095058 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0a0a74c9-4b4f-4b33-970b-cc95e23f0a2c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:52.102115 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0a0a74c9-4b4f-4b33-970b-cc95e23f0a2c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:52.104051 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0a0a74c9-4b4f-4b33-970b-cc95e23f0a2c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:52.104051 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0a0a74c9-4b4f-4b33-970b-cc95e23f0a2c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:52.104557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0a0a74c9-4b4f-4b33-970b-cc95e23f0a2c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:52.254407 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0a0a74c9-4b4f-4b33-970b-cc95e23f0a2c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:52.263195 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0a0a74c9-4b4f-4b33-970b-cc95e23f0a2c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1442 microversion: 2.1 time: 0.173501 Jun 03 13:32:52.263763 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 600/1107] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:52 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1442 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:53.006491 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d7168aa9-7d7a-4a8c-bb5b-95e25011e6c6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:53.007611 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d7168aa9-7d7a-4a8c-bb5b-95e25011e6c6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:53.014865 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7168aa9-7d7a-4a8c-bb5b-95e25011e6c6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:53.015435 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7168aa9-7d7a-4a8c-bb5b-95e25011e6c6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:53.016322 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7168aa9-7d7a-4a8c-bb5b-95e25011e6c6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:53.016661 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7168aa9-7d7a-4a8c-bb5b-95e25011e6c6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:53.173834 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d7168aa9-7d7a-4a8c-bb5b-95e25011e6c6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:53.183683 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d7168aa9-7d7a-4a8c-bb5b-95e25011e6c6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.181235 Jun 03 13:32:53.184441 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 508/1108] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:53 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:54.201231 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-69f677fa-4d50-4360-856c-4c625aef5788 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:54.201766 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-69f677fa-4d50-4360-856c-4c625aef5788 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:54.208300 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-69f677fa-4d50-4360-856c-4c625aef5788 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:54.208751 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-69f677fa-4d50-4360-856c-4c625aef5788 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:54.209539 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-69f677fa-4d50-4360-856c-4c625aef5788 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:54.209972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-69f677fa-4d50-4360-856c-4c625aef5788 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:54.439264 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-69f677fa-4d50-4360-856c-4c625aef5788 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:54.447598 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-69f677fa-4d50-4360-856c-4c625aef5788 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.251081 Jun 03 13:32:54.448185 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 601/1109] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:54 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:54.605361 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-ab24d272-0a43-483d-8e08-32db788626cb req-725d708e-fc9d-408a-a780-1de40ad4b4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e599e23-8550-45f3-aa57-3a875f922883", "tag": "14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:32:54.622064 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:54.624547 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-ab24d272-0a43-483d-8e08-32db788626cb req-725d708e-fc9d-408a-a780-1de40ad4b4f0 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:54.625063 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-ab24d272-0a43-483d-8e08-32db788626cb req-725d708e-fc9d-408a-a780-1de40ad4b4f0 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:54.637376 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-ab24d272-0a43-483d-8e08-32db788626cb req-725d708e-fc9d-408a-a780-1de40ad4b4f0 service nova] Creating event network-changed:14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c for instance 5e599e23-8550-45f3-aa57-3a875f922883 on hv-cinder-80135 Jun 03 13:32:54.643203 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-ab24d272-0a43-483d-8e08-32db788626cb req-725d708e-fc9d-408a-a780-1de40ad4b4f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042637 Jun 03 13:32:54.644124 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 509/1110] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:32:55.466282 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e4cb4dfa-3193-48cb-912f-f50859124395 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:55.469291 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e4cb4dfa-3193-48cb-912f-f50859124395 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:55.473611 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4cb4dfa-3193-48cb-912f-f50859124395 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:55.473991 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4cb4dfa-3193-48cb-912f-f50859124395 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:55.474854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4cb4dfa-3193-48cb-912f-f50859124395 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:55.475286 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e4cb4dfa-3193-48cb-912f-f50859124395 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:55.623168 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e4cb4dfa-3193-48cb-912f-f50859124395 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:55.631913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e4cb4dfa-3193-48cb-912f-f50859124395 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.171035 Jun 03 13:32:55.632578 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 602/1111] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:55 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:56.646311 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=8 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:56.651731 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a5e98083-8624-4ff9-9a2b-c91d776e1fc6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:56.652441 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a5e98083-8624-4ff9-9a2b-c91d776e1fc6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:56.658942 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a5e98083-8624-4ff9-9a2b-c91d776e1fc6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:56.659385 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a5e98083-8624-4ff9-9a2b-c91d776e1fc6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:56.660140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a5e98083-8624-4ff9-9a2b-c91d776e1fc6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:56.660595 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a5e98083-8624-4ff9-9a2b-c91d776e1fc6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:56.803379 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a5e98083-8624-4ff9-9a2b-c91d776e1fc6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:56.820919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a5e98083-8624-4ff9-9a2b-c91d776e1fc6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.168192 Jun 03 13:32:56.821035 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 510/1112] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:56 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:56.995979 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0ffabf63-644b-4316-8535-23c46a711f77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:56.997569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0ffabf63-644b-4316-8535-23c46a711f77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:57.006317 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0ffabf63-644b-4316-8535-23c46a711f77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:57.006839 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0ffabf63-644b-4316-8535-23c46a711f77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:57.007679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0ffabf63-644b-4316-8535-23c46a711f77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:57.008120 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0ffabf63-644b-4316-8535-23c46a711f77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:57.035597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0ffabf63-644b-4316-8535-23c46a711f77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/ips" status: 200 len: 150 microversion: 2.1 time: 0.044810 Jun 03 13:32:57.036197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 603/1113] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 13:32:56 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:32:57.835117 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-69ee5363-ee77-4ec5-bf18-919ce552cc99 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:57.835721 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-69ee5363-ee77-4ec5-bf18-919ce552cc99 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:57.843378 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-69ee5363-ee77-4ec5-bf18-919ce552cc99 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:57.843821 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-69ee5363-ee77-4ec5-bf18-919ce552cc99 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:57.844632 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-69ee5363-ee77-4ec5-bf18-919ce552cc99 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:57.845069 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-69ee5363-ee77-4ec5-bf18-919ce552cc99 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:57.983538 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-69ee5363-ee77-4ec5-bf18-919ce552cc99 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:57.991035 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-69ee5363-ee77-4ec5-bf18-919ce552cc99 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.159904 Jun 03 13:32:57.991594 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 511/1114] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:57 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:59.008433 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-03f40d07-871f-442d-a786-dd4396dad44d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:32:59.009840 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-03f40d07-871f-442d-a786-dd4396dad44d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:59.016401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-03f40d07-871f-442d-a786-dd4396dad44d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:59.016849 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-03f40d07-871f-442d-a786-dd4396dad44d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:59.017601 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-03f40d07-871f-442d-a786-dd4396dad44d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:59.018034 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-03f40d07-871f-442d-a786-dd4396dad44d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:59.153340 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-03f40d07-871f-442d-a786-dd4396dad44d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:32:59.161409 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-03f40d07-871f-442d-a786-dd4396dad44d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.157145 Jun 03 13:32:59.162035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 604/1115] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:32:59 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:32:59.688910 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-ea23d15a-9830-446e-afc5-b165caa64271 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14f9afe3-189d-46ec-b90f-c28ded740bbd"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:32:59.689981 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-ea23d15a-9830-446e-afc5-b165caa64271 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:32:59.697392 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ea23d15a-9830-446e-afc5-b165caa64271 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:59.697884 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ea23d15a-9830-446e-afc5-b165caa64271 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:32:59.698685 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ea23d15a-9830-446e-afc5-b165caa64271 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:32:59.699128 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-ea23d15a-9830-446e-afc5-b165caa64271 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:00.178197 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-affde864-a95b-4300-83ff-13b8130f16fb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:00.178861 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-affde864-a95b-4300-83ff-13b8130f16fb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:00.186273 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-affde864-a95b-4300-83ff-13b8130f16fb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:00.186731 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-affde864-a95b-4300-83ff-13b8130f16fb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:00.187510 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-affde864-a95b-4300-83ff-13b8130f16fb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:00.187956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-affde864-a95b-4300-83ff-13b8130f16fb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:00.324124 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-affde864-a95b-4300-83ff-13b8130f16fb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:33:00.332588 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-affde864-a95b-4300-83ff-13b8130f16fb tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.158241 Jun 03 13:33:00.333170 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 605/1116] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:00 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:33:00.489003 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-ea23d15a-9830-446e-afc5-b165caa64271 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "POST /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.803950 Jun 03 13:33:00.489631 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 512/1117] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:32:59 2022] POST /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:33:01.350035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-064836da-7162-4aaa-85b8-dfc5de95d47c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:01.350585 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-064836da-7162-4aaa-85b8-dfc5de95d47c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:01.357396 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-064836da-7162-4aaa-85b8-dfc5de95d47c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:01.357847 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-064836da-7162-4aaa-85b8-dfc5de95d47c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:01.358608 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-064836da-7162-4aaa-85b8-dfc5de95d47c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:01.359045 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-064836da-7162-4aaa-85b8-dfc5de95d47c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:01.498239 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-064836da-7162-4aaa-85b8-dfc5de95d47c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:33:01.506380 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-064836da-7162-4aaa-85b8-dfc5de95d47c tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.160564 Jun 03 13:33:01.506942 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 606/1118] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:01 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:33:02.214941 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-48534f65-adc9-4fa7-9411-db6c116e6101 req-0f38a29d-5644-468e-9016-59b3a4ca2e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8652e1dc-fa91-404d-9748-44c988f06a51", "name": "network-vif-plugged", "status": "completed", "tag": "62634e0e-67f6-48f8-9f4a-af413bba9c4e"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:33:02.223786 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-48534f65-adc9-4fa7-9411-db6c116e6101 req-0f38a29d-5644-468e-9016-59b3a4ca2e89 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:02.224257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-48534f65-adc9-4fa7-9411-db6c116e6101 req-0f38a29d-5644-468e-9016-59b3a4ca2e89 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:02.236716 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-48534f65-adc9-4fa7-9411-db6c116e6101 req-0f38a29d-5644-468e-9016-59b3a4ca2e89 service nova] Creating event network-vif-plugged:62634e0e-67f6-48f8-9f4a-af413bba9c4e for instance 8652e1dc-fa91-404d-9748-44c988f06a51 on hv-cinder-80135 Jun 03 13:33:02.241413 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-48534f65-adc9-4fa7-9411-db6c116e6101 req-0f38a29d-5644-468e-9016-59b3a4ca2e89 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032130 Jun 03 13:33:02.242086 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 513/1119] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:33:02.524911 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5c8a51a7-6fdc-406d-ac32-d500a70edfa8 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:02.525585 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5c8a51a7-6fdc-406d-ac32-d500a70edfa8 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:02.532066 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5c8a51a7-6fdc-406d-ac32-d500a70edfa8 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:02.532545 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5c8a51a7-6fdc-406d-ac32-d500a70edfa8 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:02.533303 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5c8a51a7-6fdc-406d-ac32-d500a70edfa8 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:02.533738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5c8a51a7-6fdc-406d-ac32-d500a70edfa8 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:02.674890 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5c8a51a7-6fdc-406d-ac32-d500a70edfa8 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:33:02.686549 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5c8a51a7-6fdc-406d-ac32-d500a70edfa8 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.166206 Jun 03 13:33:02.687158 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 607/1120] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:02 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:33:03.704476 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-99e05cce-0307-4f1b-a9ea-da8ea4e22826 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:03.705139 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-99e05cce-0307-4f1b-a9ea-da8ea4e22826 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:03.712583 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-99e05cce-0307-4f1b-a9ea-da8ea4e22826 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:03.713025 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-99e05cce-0307-4f1b-a9ea-da8ea4e22826 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:03.713961 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-99e05cce-0307-4f1b-a9ea-da8ea4e22826 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:03.714569 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-99e05cce-0307-4f1b-a9ea-da8ea4e22826 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:03.861047 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-99e05cce-0307-4f1b-a9ea-da8ea4e22826 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:33:03.870083 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-99e05cce-0307-4f1b-a9ea-da8ea4e22826 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.170239 Jun 03 13:33:03.870663 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 514/1121] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:03 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:33:04.886964 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2ad4829d-9c77-4811-82f6-adf399e8f67d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:04.887511 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2ad4829d-9c77-4811-82f6-adf399e8f67d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:04.894018 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2ad4829d-9c77-4811-82f6-adf399e8f67d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:04.894476 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2ad4829d-9c77-4811-82f6-adf399e8f67d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:04.895264 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2ad4829d-9c77-4811-82f6-adf399e8f67d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:04.895702 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2ad4829d-9c77-4811-82f6-adf399e8f67d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:05.306800 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2ad4829d-9c77-4811-82f6-adf399e8f67d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:33:05.314907 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2ad4829d-9c77-4811-82f6-adf399e8f67d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1264 microversion: 2.1 time: 0.431843 Jun 03 13:33:05.315493 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 608/1122] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:04 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1264 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:33:06.332556 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-5891e9f4-7ae5-4d76-bddc-20ca95d71f04 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:06.333124 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-5891e9f4-7ae5-4d76-bddc-20ca95d71f04 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:06.339649 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5891e9f4-7ae5-4d76-bddc-20ca95d71f04 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:06.340094 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5891e9f4-7ae5-4d76-bddc-20ca95d71f04 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:06.340881 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5891e9f4-7ae5-4d76-bddc-20ca95d71f04 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:06.341310 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5891e9f4-7ae5-4d76-bddc-20ca95d71f04 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:06.473137 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5891e9f4-7ae5-4d76-bddc-20ca95d71f04 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:33:06.481372 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-5891e9f4-7ae5-4d76-bddc-20ca95d71f04 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1450 microversion: 2.1 time: 0.152977 Jun 03 13:33:06.481940 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 515/1123] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:06 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:33:06.498121 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-882491b3-53df-452c-ade1-6c9959318567 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:06.498764 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-882491b3-53df-452c-ade1-6c9959318567 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:06.505940 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-882491b3-53df-452c-ade1-6c9959318567 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:06.506396 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-882491b3-53df-452c-ade1-6c9959318567 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:06.507172 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-882491b3-53df-452c-ade1-6c9959318567 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:06.507615 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-882491b3-53df-452c-ade1-6c9959318567 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:06.637501 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-882491b3-53df-452c-ade1-6c9959318567 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:33:06.639772 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=100 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:06.646288 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-882491b3-53df-452c-ade1-6c9959318567 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1450 microversion: 2.1 time: 0.152748 Jun 03 13:33:06.648241 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 609/1124] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:06 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:33:08.771372 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-bb11f2df-72ba-46e3-8617-2b1cd06ddf45 req-f88f6966-71d8-481b-8196-ea8fbc935701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8652e1dc-fa91-404d-9748-44c988f06a51", "tag": "62634e0e-67f6-48f8-9f4a-af413bba9c4e"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:33:08.781264 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-bb11f2df-72ba-46e3-8617-2b1cd06ddf45 req-f88f6966-71d8-481b-8196-ea8fbc935701 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:08.785980 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-bb11f2df-72ba-46e3-8617-2b1cd06ddf45 req-f88f6966-71d8-481b-8196-ea8fbc935701 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:08.794706 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-bb11f2df-72ba-46e3-8617-2b1cd06ddf45 req-f88f6966-71d8-481b-8196-ea8fbc935701 service nova] Creating event network-changed:62634e0e-67f6-48f8-9f4a-af413bba9c4e for instance 8652e1dc-fa91-404d-9748-44c988f06a51 on hv-cinder-80135 Jun 03 13:33:08.799974 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-bb11f2df-72ba-46e3-8617-2b1cd06ddf45 req-f88f6966-71d8-481b-8196-ea8fbc935701 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032434 Jun 03 13:33:08.800690 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 516/1125] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:33:09.625639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-334410ea-62c9-4001-ab67-9003ff266300 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:09.626191 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-334410ea-62c9-4001-ab67-9003ff266300 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:09.635816 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-334410ea-62c9-4001-ab67-9003ff266300 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:09.635816 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-334410ea-62c9-4001-ab67-9003ff266300 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:09.636470 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-334410ea-62c9-4001-ab67-9003ff266300 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:09.636907 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-334410ea-62c9-4001-ab67-9003ff266300 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:09.725241 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-334410ea-62c9-4001-ab67-9003ff266300 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lazy-loading 'services' on Instance uuid 59a50313-9112-47c6-b1f5-52c062ac8481 {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:33:09.999591 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-334410ea-62c9-4001-ab67-9003ff266300 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/os-volume_attachments/14f9afe3-189d-46ec-b90f-c28ded740bbd" status: 202 len: 0 microversion: 2.1 time: 0.377773 Jun 03 13:33:10.000213 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 610/1126] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 13:33:09 2022] DELETE /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/os-volume_attachments/14f9afe3-189d-46ec-b90f-c28ded740bbd => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:33:10.009421 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d6a5a1f2-0de2-4879-92d1-c7929872e582 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:10.011355 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d6a5a1f2-0de2-4879-92d1-c7929872e582 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:10.018042 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d6a5a1f2-0de2-4879-92d1-c7929872e582 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:10.018489 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d6a5a1f2-0de2-4879-92d1-c7929872e582 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:10.019317 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d6a5a1f2-0de2-4879-92d1-c7929872e582 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:10.019757 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d6a5a1f2-0de2-4879-92d1-c7929872e582 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:10.050335 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d6a5a1f2-0de2-4879-92d1-c7929872e582 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045135 Jun 03 13:33:10.050892 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 517/1127] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:33:10 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:33:11.063103 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1ea6e3ad-370a-4b72-8730-611f1b17d732 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:11.064099 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-1ea6e3ad-370a-4b72-8730-611f1b17d732 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:11.070294 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1ea6e3ad-370a-4b72-8730-611f1b17d732 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:11.070747 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1ea6e3ad-370a-4b72-8730-611f1b17d732 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:11.071495 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1ea6e3ad-370a-4b72-8730-611f1b17d732 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:11.071927 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1ea6e3ad-370a-4b72-8730-611f1b17d732 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:11.101295 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1ea6e3ad-370a-4b72-8730-611f1b17d732 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042999 Jun 03 13:33:11.102036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 611/1128] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:33:11 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:33:12.112928 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-36702670-6ef4-4306-b83d-990f52d968bd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:12.113846 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-36702670-6ef4-4306-b83d-990f52d968bd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:12.120883 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-36702670-6ef4-4306-b83d-990f52d968bd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:12.121339 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-36702670-6ef4-4306-b83d-990f52d968bd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:12.122105 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-36702670-6ef4-4306-b83d-990f52d968bd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:12.122542 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-36702670-6ef4-4306-b83d-990f52d968bd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:12.151865 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-36702670-6ef4-4306-b83d-990f52d968bd tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042856 Jun 03 13:33:12.152458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 518/1129] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 13:33:12 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:33:12.212542 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b48aaf41-e2d9-4ad6-951b-c4b0fdd01031 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:12.213167 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b48aaf41-e2d9-4ad6-951b-c4b0fdd01031 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:12.219569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b48aaf41-e2d9-4ad6-951b-c4b0fdd01031 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:12.220014 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b48aaf41-e2d9-4ad6-951b-c4b0fdd01031 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:12.220803 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b48aaf41-e2d9-4ad6-951b-c4b0fdd01031 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:12.221239 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b48aaf41-e2d9-4ad6-951b-c4b0fdd01031 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:12.246497 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b48aaf41-e2d9-4ad6-951b-c4b0fdd01031 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Going to try to terminate instance {{(pid=118179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:33:12.519531 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b48aaf41-e2d9-4ad6-951b-c4b0fdd01031 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 204 len: 0 microversion: 2.1 time: 0.310460 Jun 03 13:33:12.520168 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 612/1130] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:33:12 2022] DELETE /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:33:12.529111 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b407f937-76ab-4da5-84f4-fd295c6baa34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:12.529769 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b407f937-76ab-4da5-84f4-fd295c6baa34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:12.535874 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b407f937-76ab-4da5-84f4-fd295c6baa34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:12.536619 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b407f937-76ab-4da5-84f4-fd295c6baa34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:12.537495 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b407f937-76ab-4da5-84f4-fd295c6baa34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:12.537972 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b407f937-76ab-4da5-84f4-fd295c6baa34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:12.540757 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:12.671219 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b407f937-76ab-4da5-84f4-fd295c6baa34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:33:12.678876 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b407f937-76ab-4da5-84f4-fd295c6baa34 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1680 microversion: 2.1 time: 0.154505 Jun 03 13:33:12.679436 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 519/1131] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:12 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:33:13.696697 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a3d1aca8-0f12-4beb-ad4a-586f157a328b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:13.697907 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a3d1aca8-0f12-4beb-ad4a-586f157a328b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:13.704407 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a3d1aca8-0f12-4beb-ad4a-586f157a328b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:13.704866 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a3d1aca8-0f12-4beb-ad4a-586f157a328b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:13.705627 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a3d1aca8-0f12-4beb-ad4a-586f157a328b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:13.706065 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a3d1aca8-0f12-4beb-ad4a-586f157a328b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:13.836769 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a3d1aca8-0f12-4beb-ad4a-586f157a328b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:33:13.844916 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a3d1aca8-0f12-4beb-ad4a-586f157a328b tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1680 microversion: 2.1 time: 0.152452 Jun 03 13:33:13.845485 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 613/1132] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:13 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:33:14.862460 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-eea730a7-f1b5-40bb-9fe4-c2cf1a4d26cf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:14.863075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-eea730a7-f1b5-40bb-9fe4-c2cf1a4d26cf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:14.870238 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-eea730a7-f1b5-40bb-9fe4-c2cf1a4d26cf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:14.870686 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-eea730a7-f1b5-40bb-9fe4-c2cf1a4d26cf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:14.871452 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-eea730a7-f1b5-40bb-9fe4-c2cf1a4d26cf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:14.871889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-eea730a7-f1b5-40bb-9fe4-c2cf1a4d26cf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:15.007073 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-eea730a7-f1b5-40bb-9fe4-c2cf1a4d26cf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:33:15.014889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-eea730a7-f1b5-40bb-9fe4-c2cf1a4d26cf tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1680 microversion: 2.1 time: 0.156456 Jun 03 13:33:15.015458 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 520/1133] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:14 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:33:16.034334 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-59520882-1cd7-465a-99c7-ac06b271aa82 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:16.037057 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-59520882-1cd7-465a-99c7-ac06b271aa82 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:16.042281 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-59520882-1cd7-465a-99c7-ac06b271aa82 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:16.043132 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-59520882-1cd7-465a-99c7-ac06b271aa82 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:16.044072 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-59520882-1cd7-465a-99c7-ac06b271aa82 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:16.044918 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-59520882-1cd7-465a-99c7-ac06b271aa82 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:16.111158 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-59520882-1cd7-465a-99c7-ac06b271aa82 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267a2b59a70245dfb7ec1b779f7fdd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8468b823dd4e408c98dc1eb01f3019c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:33:16.119981 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-59520882-1cd7-465a-99c7-ac06b271aa82 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 200 len: 1613 microversion: 2.1 time: 0.091227 Jun 03 13:33:16.120778 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 521/1134] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:16 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 1613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:33:16.160905 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-3b355a4c-df7f-4c70-85f1-7b53ecb46ec0 req-0af9b6cc-062f-40d0-9c8b-0bddc138ae97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a50313-9112-47c6-b1f5-52c062ac8481", "name": "network-vif-deleted", "tag": "2d8c994e-a998-470e-b0af-9852842f12b7"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:33:16.171505 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-3b355a4c-df7f-4c70-85f1-7b53ecb46ec0 req-0af9b6cc-062f-40d0-9c8b-0bddc138ae97 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:16.171956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-3b355a4c-df7f-4c70-85f1-7b53ecb46ec0 req-0af9b6cc-062f-40d0-9c8b-0bddc138ae97 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:16.185536 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-3b355a4c-df7f-4c70-85f1-7b53ecb46ec0 req-0af9b6cc-062f-40d0-9c8b-0bddc138ae97 service nova] Creating event network-vif-deleted:2d8c994e-a998-470e-b0af-9852842f12b7 for instance 59a50313-9112-47c6-b1f5-52c062ac8481 on hv-cinder-80135 Jun 03 13:33:16.190970 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-3b355a4c-df7f-4c70-85f1-7b53ecb46ec0 req-0af9b6cc-062f-40d0-9c8b-0bddc138ae97 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188288 Jun 03 13:33:16.191812 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 614/1135] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:33:17.138110 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-556526d7-b542-44f7-8dc3-99b503d7909d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:17.138718 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-556526d7-b542-44f7-8dc3-99b503d7909d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:17.145644 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-556526d7-b542-44f7-8dc3-99b503d7909d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:17.146091 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-556526d7-b542-44f7-8dc3-99b503d7909d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:17.146844 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-556526d7-b542-44f7-8dc3-99b503d7909d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:17.147275 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-556526d7-b542-44f7-8dc3-99b503d7909d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:17.160849 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-556526d7-b542-44f7-8dc3-99b503d7909d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-556526d7-b542-44f7-8dc3-99b503d7909d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 HTTP/1.1 Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:33:17.162466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:33:17.164080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:33:17.164080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:17.164080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:17.164080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:17.164080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:17.164080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:33:17.164080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:33:17.164080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:33:17.164080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:17.164080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:33:17.164080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:17.164080 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '59a50313-9112-47c6-b1f5-52c062ac8481'} Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:33:17.168212 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:17.169557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:17.170738 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-556526d7-b542-44f7-8dc3-99b503d7909d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 404 to user: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:33:17.170738 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-556526d7-b542-44f7-8dc3-99b503d7909d tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 404 len: 111 microversion: 2.1 time: 0.030620 Jun 03 13:33:17.170738 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 522/1136] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:17 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:33:17.174063 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e43507f4-3863-4e8b-8219-ba2ef83c02d3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '.version_select at 0x7f5bc87d7a60>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:17.248302 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e43507f4-3863-4e8b-8219-ba2ef83c02d3 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838016203" status: 202 len: 0 microversion: 2.1 time: 0.078898 Jun 03 13:33:17.248918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 615/1137] 10.222.0.61 () {58 vars in 1217 bytes} [Fri Jun 3 13:33:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838016203 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:33:19.222961 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-cda57451-5d9d-441e-a7f4-6cb56253c3b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:19.223593 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-cda57451-5d9d-441e-a7f4-6cb56253c3b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:19.230176 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cda57451-5d9d-441e-a7f4-6cb56253c3b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:19.230627 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cda57451-5d9d-441e-a7f4-6cb56253c3b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:19.231386 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cda57451-5d9d-441e-a7f4-6cb56253c3b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:19.231824 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cda57451-5d9d-441e-a7f4-6cb56253c3b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:19.245290 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-cda57451-5d9d-441e-a7f4-6cb56253c3b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-cda57451-5d9d-441e-a7f4-6cb56253c3b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: DELETE /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 HTTP/1.1 Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:33:19.250442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:33:19.252116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:33:19.252116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:19.252116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:19.252116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:19.252116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:19.252116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:33:19.252116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:33:19.252116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:33:19.252116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:19.252116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:33:19.252116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:19.252116 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '59a50313-9112-47c6-b1f5-52c062ac8481'} Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:33:19.253395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:19.255277 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:19.257021 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-cda57451-5d9d-441e-a7f4-6cb56253c3b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 404 to user: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:33:19.257021 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-cda57451-5d9d-441e-a7f4-6cb56253c3b2 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 404 len: 111 microversion: 2.1 time: 0.029052 Jun 03 13:33:19.257021 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 523/1138] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:33:19 2022] DELETE /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:33:19.258100 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-11c53fb9-499d-4047-8c60-a3efffc6fd77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:19.258819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-11c53fb9-499d-4047-8c60-a3efffc6fd77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 59a50313-9112-47c6-b1f5-52c062ac8481] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:19.261353 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:19.266716 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-11c53fb9-499d-4047-8c60-a3efffc6fd77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:19.267166 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-11c53fb9-499d-4047-8c60-a3efffc6fd77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:19.267965 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-11c53fb9-499d-4047-8c60-a3efffc6fd77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:19.268390 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-11c53fb9-499d-4047-8c60-a3efffc6fd77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:19.283766 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-11c53fb9-499d-4047-8c60-a3efffc6fd77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-11c53fb9-499d-4047-8c60-a3efffc6fd77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 HTTP/1.1 Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:33:19.285401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:33:19.287762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:33:19.287762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:19.287762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:19.287762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:19.287762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:19.287762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:33:19.287762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:33:19.287762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:33:19.287762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:19.287762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:33:19.287762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:19.287762 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '59a50313-9112-47c6-b1f5-52c062ac8481'} Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:33:19.289283 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. Jun 03 13:33:19.291949 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:19.294435 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-11c53fb9-499d-4047-8c60-a3efffc6fd77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 404 to user: Instance 59a50313-9112-47c6-b1f5-52c062ac8481 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:33:19.294435 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-11c53fb9-499d-4047-8c60-a3efffc6fd77 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481" status: 404 len: 111 microversion: 2.1 time: 0.033246 Jun 03 13:33:19.294435 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 616/1139] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:19 2022] GET /compute/v2.1/servers/59a50313-9112-47c6-b1f5-52c062ac8481 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:33:20.562812 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8b660d99-2fe3-4dd3-8139-01f5f015e644 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:20.563312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8b660d99-2fe3-4dd3-8139-01f5f015e644 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:20.569810 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8b660d99-2fe3-4dd3-8139-01f5f015e644 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:20.570259 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8b660d99-2fe3-4dd3-8139-01f5f015e644 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:20.571025 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8b660d99-2fe3-4dd3-8139-01f5f015e644 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:20.571461 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8b660d99-2fe3-4dd3-8139-01f5f015e644 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:20.585778 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-8b660d99-2fe3-4dd3-8139-01f5f015e644 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8b660d99-2fe3-4dd3-8139-01f5f015e644 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: DELETE /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba HTTP/1.1 Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:33:20.587346 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:33:20.589735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:33:20.589735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:20.589735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:20.589735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:20.589735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:20.589735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:33:20.589735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:33:20.589735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:33:20.589735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:20.589735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:33:20.589735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:33:20.589735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': 'a9457ca1-60e7-419b-9c30-10d88085d7ba'} Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:33:20.590582 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:33:20.592257 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.593721 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8b660d99-2fe3-4dd3-8139-01f5f015e644 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 404 to user: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:33:20.593721 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8b660d99-2fe3-4dd3-8139-01f5f015e644 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 404 len: 111 microversion: 2.1 time: 0.030587 Jun 03 13:33:20.593721 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 524/1140] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:33:20 2022] DELETE /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:33:20.609562 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-235e31d4-a126-4ad0-b9c7-d46b15c5cc52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:20.609562 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-235e31d4-a126-4ad0-b9c7-d46b15c5cc52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: a9457ca1-60e7-419b-9c30-10d88085d7ba] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:20.609562 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-235e31d4-a126-4ad0-b9c7-d46b15c5cc52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:20.609562 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-235e31d4-a126-4ad0-b9c7-d46b15c5cc52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:20.610466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-235e31d4-a126-4ad0-b9c7-d46b15c5cc52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:20.610466 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-235e31d4-a126-4ad0-b9c7-d46b15c5cc52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:20.622320 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-235e31d4-a126-4ad0-b9c7-d46b15c5cc52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-235e31d4-a126-4ad0-b9c7-d46b15c5cc52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba HTTP/1.1 Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:33:20.628106 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:33:20.630284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:33:20.630284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:20.630284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:20.630284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:20.630284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:20.630284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:33:20.630284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:33:20.630284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:33:20.630284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:20.630284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:33:20.630284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:33:20.630284 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': 'a9457ca1-60e7-419b-9c30-10d88085d7ba'} Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:33:20.631296 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. Jun 03 13:33:20.632864 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.634202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-235e31d4-a126-4ad0-b9c7-d46b15c5cc52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 404 to user: Instance a9457ca1-60e7-419b-9c30-10d88085d7ba could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:33:20.634202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-235e31d4-a126-4ad0-b9c7-d46b15c5cc52 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba" status: 404 len: 111 microversion: 2.1 time: 0.031204 Jun 03 13:33:20.634202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 617/1141] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:20 2022] GET /compute/v2.1/servers/a9457ca1-60e7-419b-9c30-10d88085d7ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:33:20.635001 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-80b697e1-b20f-4f03-a5e5-924be4a02a03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:20.635312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-80b697e1-b20f-4f03-a5e5-924be4a02a03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:20.637403 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=46 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:20.642262 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-80b697e1-b20f-4f03-a5e5-924be4a02a03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:20.642717 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-80b697e1-b20f-4f03-a5e5-924be4a02a03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:20.643518 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-80b697e1-b20f-4f03-a5e5-924be4a02a03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:20.643962 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-80b697e1-b20f-4f03-a5e5-924be4a02a03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:20.658418 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-80b697e1-b20f-4f03-a5e5-924be4a02a03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-80b697e1-b20f-4f03-a5e5-924be4a02a03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: DELETE /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 HTTP/1.1 Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:33:20.659967 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:33:20.661652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:33:20.661652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:20.661652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:20.661652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:20.661652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:20.661652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:33:20.661652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:33:20.661652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:33:20.661652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:20.661652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:33:20.661652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:33:20.661652 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': 'c95a8052-ebb8-4326-83e4-85340beb68e7'} Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:33:20.662578 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:33:20.664075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.665531 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-80b697e1-b20f-4f03-a5e5-924be4a02a03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 404 to user: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:33:20.665531 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-80b697e1-b20f-4f03-a5e5-924be4a02a03 tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 404 len: 111 microversion: 2.1 time: 0.031225 Jun 03 13:33:20.665531 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 525/1142] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:33:20 2022] DELETE /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:33:20.670809 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d7b7db52-1647-4957-b10b-5420b7e163ba tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:20.673140 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d7b7db52-1647-4957-b10b-5420b7e163ba tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: c95a8052-ebb8-4326-83e4-85340beb68e7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:20.677589 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d7b7db52-1647-4957-b10b-5420b7e163ba tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:20.678033 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d7b7db52-1647-4957-b10b-5420b7e163ba tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:20.678823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d7b7db52-1647-4957-b10b-5420b7e163ba tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:20.679255 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d7b7db52-1647-4957-b10b-5420b7e163ba tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:20.694448 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-d7b7db52-1647-4957-b10b-5420b7e163ba tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d7b7db52-1647-4957-b10b-5420b7e163ba tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 HTTP/1.1 Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:33:20.696044 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:33:20.702625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:33:20.702625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:20.702625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:20.702625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:20.702625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:20.702625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:33:20.702625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:33:20.702625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:33:20.702625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:20.702625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:33:20.702625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:33:20.702625 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': 'c95a8052-ebb8-4326-83e4-85340beb68e7'} Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:33:20.703526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. Jun 03 13:33:20.705220 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:20.706535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d7b7db52-1647-4957-b10b-5420b7e163ba tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 404 to user: Instance c95a8052-ebb8-4326-83e4-85340beb68e7 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:33:20.706535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d7b7db52-1647-4957-b10b-5420b7e163ba tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7" status: 404 len: 111 microversion: 2.1 time: 0.031201 Jun 03 13:33:20.706535 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 618/1143] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:20 2022] GET /compute/v2.1/servers/c95a8052-ebb8-4326-83e4-85340beb68e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:33:22.003620 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4c56f0d0-9c3f-44b5-a82d-59c4fea41f9a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:22.004019 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4c56f0d0-9c3f-44b5-a82d-59c4fea41f9a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:22.011756 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4c56f0d0-9c3f-44b5-a82d-59c4fea41f9a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:22.012235 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4c56f0d0-9c3f-44b5-a82d-59c4fea41f9a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:22.013012 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4c56f0d0-9c3f-44b5-a82d-59c4fea41f9a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:22.013450 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4c56f0d0-9c3f-44b5-a82d-59c4fea41f9a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:22.027500 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-4c56f0d0-9c3f-44b5-a82d-59c4fea41f9a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4c56f0d0-9c3f-44b5-a82d-59c4fea41f9a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: DELETE /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc HTTP/1.1 Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:33:22.029085 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:33:22.030712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:33:22.030712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:22.030712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:22.030712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:22.030712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:22.030712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:33:22.030712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:33:22.030712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:33:22.030712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:22.030712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:33:22.030712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:33:22.030712 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '7f916e17-eccc-4c6d-b3cd-9517056abcfc'} Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:33:22.031760 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:33:22.033278 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:33:22.034848 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4c56f0d0-9c3f-44b5-a82d-59c4fea41f9a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 404 to user: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:33:22.034848 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4c56f0d0-9c3f-44b5-a82d-59c4fea41f9a tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 404 len: 111 microversion: 2.1 time: 0.031073 Jun 03 13:33:22.034848 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 526/1144] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:33:21 2022] DELETE /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:33:22.039271 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5be99587-e7c5-4824-b8aa-d9f44604feee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:33:22.039887 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5be99587-e7c5-4824-b8aa-d9f44604feee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] [instance: 7f916e17-eccc-4c6d-b3cd-9517056abcfc] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:33:22.046464 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5be99587-e7c5-4824-b8aa-d9f44604feee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:22.046915 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5be99587-e7c5-4824-b8aa-d9f44604feee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:22.047671 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5be99587-e7c5-4824-b8aa-d9f44604feee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:33:22.048103 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5be99587-e7c5-4824-b8aa-d9f44604feee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:33:22.061597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-5be99587-e7c5-4824-b8aa-d9f44604feee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] HTTP exception thrown: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5be99587-e7c5-4824-b8aa-d9f44604feee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Request method failure captured: Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc HTTP/1.1 Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgr4zdaVpTy8RJIf9iLgCRp4B3JX2JAsbR73klSid686y6g6qWBaC_zmuHLpwOzINVkRpGjctvuyXT-0bzmGDy4uaYsGJznp1mxMVbFlHgckNsGZNLXtXZBc-_MzSrPuW1ogjxlLLEUsqSuhJ26PAwRf_A0t5UgNOMn3Ro5xMUkaob0 Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:33:22.063147 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:33:22.064837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8468b823dd4e408c98dc1eb01f3019c7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8468b823dd4e408c98dc1eb01f3019c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:33:22.064837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:22.064837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: 8468b823dd4e408c98dc1eb01f3019c7 Jun 03 13:33:22.064837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2020100405 Jun 03 13:33:22.064837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:22.064837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:33:22.064837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:33:22.064837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 267a2b59a70245dfb7ec1b779f7fdd51 Jun 03 13:33:22.064837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-AttachVolumeNegativeTest-2020100405-project Jun 03 13:33:22.064837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:33:22.064837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:33:22.064837 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '7f916e17-eccc-4c6d-b3cd-9517056abcfc'} Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:33:22.065786 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. Jun 03 13:33:22.067348 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:33:22.074306 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5be99587-e7c5-4824-b8aa-d9f44604feee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] Returning 404 to user: Instance 7f916e17-eccc-4c6d-b3cd-9517056abcfc could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:33:22.074306 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5be99587-e7c5-4824-b8aa-d9f44604feee tempest-AttachVolumeNegativeTest-2020100405 tempest-AttachVolumeNegativeTest-2020100405-project] 10.222.0.61 "GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc" status: 404 len: 111 microversion: 2.1 time: 0.029432 Jun 03 13:33:22.074306 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 619/1145] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:33:22 2022] GET /compute/v2.1/servers/7f916e17-eccc-4c6d-b3cd-9517056abcfc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:35:07.161479 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:35:07.162143 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Fri Jun 3 13:35:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:35:10.093202 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=3 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:10.093929 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=27 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:10.097882 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-539654542", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "networks": [{"uuid": "fa807772-ecd4-41bb-8519-a68ce1a9c8a3"}]}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:35:10.149559 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.network.neutron [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] validate_networks() for [('fa807772-ecd4-41bb-8519-a68ce1a9c8a3', None, None, None, None, None)] {{(pid=118178) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:35:10.533056 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Flavor limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:35:10.533473 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Image limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:35:10.533943 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Flavor pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:35:10.534371 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Image pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:35:10.534777 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:35:10.543780 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:10.544262 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:10.545057 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:10.545488 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:10.562157 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Getting quotas for project bd537e9d76aa492dab87422257286816. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:35:10.566011 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Getting quotas for user 3b71f0a1eb994da09f9a3336f2fe6eeb and project bd537e9d76aa492dab87422257286816. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:35:10.577208 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Going to run 1 instances... {{(pid=118178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:35:10.579352 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:35:10.709812 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f9f69e6a-82c0-44d7-925a-03ba535cb6e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618383 Jun 03 13:35:10.710451 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 527/1146] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:35:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:35:10.721403 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e973c65e-3cf1-450e-b4ae-54d21cd03837 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:10.722013 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e973c65e-3cf1-450e-b4ae-54d21cd03837 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:10.724091 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=7 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:10.724743 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:10.778810 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e973c65e-3cf1-450e-b4ae-54d21cd03837 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:10.786281 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e973c65e-3cf1-450e-b4ae-54d21cd03837 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1218 microversion: 2.1 time: 0.069741 Jun 03 13:35:10.793553 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 620/1147] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:10 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:11.803912 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a279f614-d874-43cc-881a-0a8f821942bb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:11.804557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a279f614-d874-43cc-881a-0a8f821942bb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:11.811341 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a279f614-d874-43cc-881a-0a8f821942bb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:11.811809 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a279f614-d874-43cc-881a-0a8f821942bb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:11.812597 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a279f614-d874-43cc-881a-0a8f821942bb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:11.813038 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a279f614-d874-43cc-881a-0a8f821942bb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:11.876520 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-a279f614-d874-43cc-881a-0a8f821942bb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:11.885024 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a279f614-d874-43cc-881a-0a8f821942bb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1222 microversion: 2.1 time: 0.084750 Jun 03 13:35:11.885797 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 528/1148] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:11 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:12.902889 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e65378f3-3461-46df-a586-b28bf0970e60 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:12.903431 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e65378f3-3461-46df-a586-b28bf0970e60 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:12.912724 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e65378f3-3461-46df-a586-b28bf0970e60 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:12.913181 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e65378f3-3461-46df-a586-b28bf0970e60 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:12.914001 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e65378f3-3461-46df-a586-b28bf0970e60 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:12.914440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e65378f3-3461-46df-a586-b28bf0970e60 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:12.976769 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e65378f3-3461-46df-a586-b28bf0970e60 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:12.984227 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e65378f3-3461-46df-a586-b28bf0970e60 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1270 microversion: 2.1 time: 0.086123 Jun 03 13:35:12.984788 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 621/1149] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:12 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:14.007115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-5970e2cb-1013-45f9-8102-cbb7fb1faa51 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:14.007836 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-5970e2cb-1013-45f9-8102-cbb7fb1faa51 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:14.014799 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5970e2cb-1013-45f9-8102-cbb7fb1faa51 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:14.015251 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5970e2cb-1013-45f9-8102-cbb7fb1faa51 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:14.016018 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5970e2cb-1013-45f9-8102-cbb7fb1faa51 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:14.016485 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5970e2cb-1013-45f9-8102-cbb7fb1faa51 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:14.208585 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5970e2cb-1013-45f9-8102-cbb7fb1faa51 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:14.217210 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-5970e2cb-1013-45f9-8102-cbb7fb1faa51 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1318 microversion: 2.1 time: 0.214276 Jun 03 13:35:14.217796 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 529/1150] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:14 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:14.882495 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-a7747117-5a02-43d9-8608-91d74720036d req-b87caeaa-83bc-4aaf-9ba9-d5e6291eaf66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1980447-8506-4fc9-a363-b193f15aa056", "tag": "ed9d39e3-b1e3-4ea5-a6ee-02103614ba7c"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:35:14.891694 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-a7747117-5a02-43d9-8608-91d74720036d req-b87caeaa-83bc-4aaf-9ba9-d5e6291eaf66 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:14.892132 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-a7747117-5a02-43d9-8608-91d74720036d req-b87caeaa-83bc-4aaf-9ba9-d5e6291eaf66 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:14.904073 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-a7747117-5a02-43d9-8608-91d74720036d req-b87caeaa-83bc-4aaf-9ba9-d5e6291eaf66 service nova] Creating event network-changed:ed9d39e3-b1e3-4ea5-a6ee-02103614ba7c for instance c1980447-8506-4fc9-a363-b193f15aa056 on hv-cinder-80135 Jun 03 13:35:14.908575 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-a7747117-5a02-43d9-8608-91d74720036d req-b87caeaa-83bc-4aaf-9ba9-d5e6291eaf66 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030519 Jun 03 13:35:14.909331 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 622/1151] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:35:15.233924 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-59a5307b-0108-4f3d-b48a-227d2b463ba0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:15.234537 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-59a5307b-0108-4f3d-b48a-227d2b463ba0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:15.240726 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-59a5307b-0108-4f3d-b48a-227d2b463ba0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:15.241172 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-59a5307b-0108-4f3d-b48a-227d2b463ba0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:15.241937 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-59a5307b-0108-4f3d-b48a-227d2b463ba0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:15.242375 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-59a5307b-0108-4f3d-b48a-227d2b463ba0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:15.462576 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-59a5307b-0108-4f3d-b48a-227d2b463ba0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:15.470411 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-59a5307b-0108-4f3d-b48a-227d2b463ba0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1318 microversion: 2.1 time: 0.240097 Jun 03 13:35:15.471006 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 530/1152] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:15 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:16.487693 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-8339dd9c-4cb3-400d-b47d-de1b6f462872 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:16.488413 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-8339dd9c-4cb3-400d-b47d-de1b6f462872 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:16.495130 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8339dd9c-4cb3-400d-b47d-de1b6f462872 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:16.495578 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8339dd9c-4cb3-400d-b47d-de1b6f462872 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:16.496366 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8339dd9c-4cb3-400d-b47d-de1b6f462872 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:16.496801 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-8339dd9c-4cb3-400d-b47d-de1b6f462872 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:16.625807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-8339dd9c-4cb3-400d-b47d-de1b6f462872 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:16.633445 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-8339dd9c-4cb3-400d-b47d-de1b6f462872 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1318 microversion: 2.1 time: 0.150437 Jun 03 13:35:16.634101 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 623/1153] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:16 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:17.650503 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7792b50d-9c25-4a98-b734-c6ef827101e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:17.651120 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-7792b50d-9c25-4a98-b734-c6ef827101e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:17.657826 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7792b50d-9c25-4a98-b734-c6ef827101e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:17.658276 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7792b50d-9c25-4a98-b734-c6ef827101e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:17.659035 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7792b50d-9c25-4a98-b734-c6ef827101e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:17.659475 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7792b50d-9c25-4a98-b734-c6ef827101e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:17.785955 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-7792b50d-9c25-4a98-b734-c6ef827101e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:17.793465 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-7792b50d-9c25-4a98-b734-c6ef827101e9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1318 microversion: 2.1 time: 0.147627 Jun 03 13:35:17.794032 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 531/1154] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:17 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:18.810865 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-85e7aba7-786e-4210-9743-045afd2e45df tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:18.811484 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-85e7aba7-786e-4210-9743-045afd2e45df tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:18.817865 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-85e7aba7-786e-4210-9743-045afd2e45df tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:18.818312 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-85e7aba7-786e-4210-9743-045afd2e45df tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:18.819136 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-85e7aba7-786e-4210-9743-045afd2e45df tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:18.819543 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-85e7aba7-786e-4210-9743-045afd2e45df tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:18.948727 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-85e7aba7-786e-4210-9743-045afd2e45df tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:18.956171 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-85e7aba7-786e-4210-9743-045afd2e45df tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1318 microversion: 2.1 time: 0.149303 Jun 03 13:35:18.956729 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 624/1155] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:18 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:19.972120 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-b356de64-fcf3-4341-9cff-6f8c338c2349 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:19.972792 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-b356de64-fcf3-4341-9cff-6f8c338c2349 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:19.979246 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b356de64-fcf3-4341-9cff-6f8c338c2349 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:19.979697 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b356de64-fcf3-4341-9cff-6f8c338c2349 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:19.980496 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b356de64-fcf3-4341-9cff-6f8c338c2349 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:19.980936 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-b356de64-fcf3-4341-9cff-6f8c338c2349 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:20.113851 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-b356de64-fcf3-4341-9cff-6f8c338c2349 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:20.122375 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-b356de64-fcf3-4341-9cff-6f8c338c2349 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1318 microversion: 2.1 time: 0.154124 Jun 03 13:35:20.122948 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 532/1156] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:19 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:35:21.139664 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3cfc7b4f-7e8a-4f01-b3c6-e70cc0c3b2b5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:21.140313 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3cfc7b4f-7e8a-4f01-b3c6-e70cc0c3b2b5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:21.142793 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:21.147637 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3cfc7b4f-7e8a-4f01-b3c6-e70cc0c3b2b5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:21.148091 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3cfc7b4f-7e8a-4f01-b3c6-e70cc0c3b2b5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:21.148909 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3cfc7b4f-7e8a-4f01-b3c6-e70cc0c3b2b5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:21.154119 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3cfc7b4f-7e8a-4f01-b3c6-e70cc0c3b2b5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:21.284257 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3cfc7b4f-7e8a-4f01-b3c6-e70cc0c3b2b5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:21.292824 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3cfc7b4f-7e8a-4f01-b3c6-e70cc0c3b2b5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1318 microversion: 2.1 time: 0.156951 Jun 03 13:35:21.293798 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 625/1157] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:21 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:21.577920 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:35:21.578477 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Fri Jun 3 13:35:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:35:22.310317 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-dc66443a-b1e9-47a4-9398-e545b7a31bd9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:22.310865 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-dc66443a-b1e9-47a4-9398-e545b7a31bd9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:22.312758 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:22.313447 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=6 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:22.318735 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dc66443a-b1e9-47a4-9398-e545b7a31bd9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:22.319190 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dc66443a-b1e9-47a4-9398-e545b7a31bd9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:22.319958 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dc66443a-b1e9-47a4-9398-e545b7a31bd9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:22.320428 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-dc66443a-b1e9-47a4-9398-e545b7a31bd9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:22.450153 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-dc66443a-b1e9-47a4-9398-e545b7a31bd9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:22.457622 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-dc66443a-b1e9-47a4-9398-e545b7a31bd9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1318 microversion: 2.1 time: 0.151368 Jun 03 13:35:22.458193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 533/1158] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:22 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:22.839550 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-0d346dd9-b50b-47ee-802e-7d977160ae9e req-4a8f8211-7701-4959-bd2e-802fa6648498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1980447-8506-4fc9-a363-b193f15aa056", "name": "network-vif-plugged", "status": "completed", "tag": "ed9d39e3-b1e3-4ea5-a6ee-02103614ba7c"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:35:22.847666 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-0d346dd9-b50b-47ee-802e-7d977160ae9e req-4a8f8211-7701-4959-bd2e-802fa6648498 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:22.848176 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-0d346dd9-b50b-47ee-802e-7d977160ae9e req-4a8f8211-7701-4959-bd2e-802fa6648498 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:22.860297 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-0d346dd9-b50b-47ee-802e-7d977160ae9e req-4a8f8211-7701-4959-bd2e-802fa6648498 service nova] Creating event network-vif-plugged:ed9d39e3-b1e3-4ea5-a6ee-02103614ba7c for instance c1980447-8506-4fc9-a363-b193f15aa056 on hv-cinder-80135 Jun 03 13:35:22.865288 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-0d346dd9-b50b-47ee-802e-7d977160ae9e req-4a8f8211-7701-4959-bd2e-802fa6648498 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159381 Jun 03 13:35:22.865904 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 626/1159] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:35:23.475087 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-371e8e54-ff9c-403d-a30e-01aa816cc34c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:23.475699 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-371e8e54-ff9c-403d-a30e-01aa816cc34c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:23.482853 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-371e8e54-ff9c-403d-a30e-01aa816cc34c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:23.483303 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-371e8e54-ff9c-403d-a30e-01aa816cc34c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:23.484068 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-371e8e54-ff9c-403d-a30e-01aa816cc34c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:23.484534 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-371e8e54-ff9c-403d-a30e-01aa816cc34c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:23.613994 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-371e8e54-ff9c-403d-a30e-01aa816cc34c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:23.622767 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-371e8e54-ff9c-403d-a30e-01aa816cc34c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1318 microversion: 2.1 time: 0.151546 Jun 03 13:35:23.623404 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 534/1160] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:23 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:24.641481 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-b4e32cf9-d6ec-4192-809a-9548a8e380dd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:24.642174 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-b4e32cf9-d6ec-4192-809a-9548a8e380dd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:24.648921 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4e32cf9-d6ec-4192-809a-9548a8e380dd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:24.649978 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4e32cf9-d6ec-4192-809a-9548a8e380dd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:24.650730 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4e32cf9-d6ec-4192-809a-9548a8e380dd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:24.651191 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-b4e32cf9-d6ec-4192-809a-9548a8e380dd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:24.779563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-b4e32cf9-d6ec-4192-809a-9548a8e380dd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:24.786940 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-b4e32cf9-d6ec-4192-809a-9548a8e380dd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1318 microversion: 2.1 time: 0.149646 Jun 03 13:35:24.787497 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 627/1161] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:24 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:25.805128 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4407abaa-e117-4975-9696-1beddfb1ab99 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:25.805830 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4407abaa-e117-4975-9696-1beddfb1ab99 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:25.813087 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4407abaa-e117-4975-9696-1beddfb1ab99 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:25.813634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4407abaa-e117-4975-9696-1beddfb1ab99 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:25.814543 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4407abaa-e117-4975-9696-1beddfb1ab99 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:25.815002 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4407abaa-e117-4975-9696-1beddfb1ab99 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:25.949443 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4407abaa-e117-4975-9696-1beddfb1ab99 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:25.957734 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4407abaa-e117-4975-9696-1beddfb1ab99 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1507 microversion: 2.1 time: 0.157064 Jun 03 13:35:25.958294 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 535/1162] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:25 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:34.772625 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:35:34.773312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Fri Jun 3 13:35:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:35:41.808791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f8ef765d-7a8b-4a2c-b602-3aa47e8e9fa6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:41.813974 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f8ef765d-7a8b-4a2c-b602-3aa47e8e9fa6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:41.814130 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-ebc5fc7f-bcdb-4a63-ad07-93a5049dbaf5 req-fc5c1793-720a-47d4-b408-ae014ff84c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8652e1dc-fa91-404d-9748-44c988f06a51", "tag": "62634e0e-67f6-48f8-9f4a-af413bba9c4e"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:35:41.814560 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=18 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:41.814836 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=34 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:41.816749 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:41.817398 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=50 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:41.818903 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f8ef765d-7a8b-4a2c-b602-3aa47e8e9fa6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:41.819606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f8ef765d-7a8b-4a2c-b602-3aa47e8e9fa6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:41.820697 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f8ef765d-7a8b-4a2c-b602-3aa47e8e9fa6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:41.821889 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-ebc5fc7f-bcdb-4a63-ad07-93a5049dbaf5 req-fc5c1793-720a-47d4-b408-ae014ff84c54 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:41.822355 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-f8ef765d-7a8b-4a2c-b602-3aa47e8e9fa6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:41.822820 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-ebc5fc7f-bcdb-4a63-ad07-93a5049dbaf5 req-fc5c1793-720a-47d4-b408-ae014ff84c54 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:41.847471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-ebc5fc7f-bcdb-4a63-ad07-93a5049dbaf5 req-fc5c1793-720a-47d4-b408-ae014ff84c54 service nova] Creating event network-changed:62634e0e-67f6-48f8-9f4a-af413bba9c4e for instance 8652e1dc-fa91-404d-9748-44c988f06a51 on hv-cinder-80135 Jun 03 13:35:41.849162 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-f8ef765d-7a8b-4a2c-b602-3aa47e8e9fa6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Going to try to terminate instance {{(pid=118179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:35:41.854291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-ebc5fc7f-bcdb-4a63-ad07-93a5049dbaf5 req-fc5c1793-720a-47d4-b408-ae014ff84c54 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047571 Jun 03 13:35:41.856513 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 536/1163] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:35:42.199900 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f8ef765d-7a8b-4a2c-b602-3aa47e8e9fa6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 204 len: 0 microversion: 2.1 time: 0.396062 Jun 03 13:35:42.200545 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 628/1164] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:35:41 2022] DELETE /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:35:42.209781 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-0d63bdd2-f717-4ca5-bfa0-9227322d1c60 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:42.210581 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-0d63bdd2-f717-4ca5-bfa0-9227322d1c60 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:42.221944 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0d63bdd2-f717-4ca5-bfa0-9227322d1c60 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:42.222535 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0d63bdd2-f717-4ca5-bfa0-9227322d1c60 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:42.223722 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0d63bdd2-f717-4ca5-bfa0-9227322d1c60 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:42.224186 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-0d63bdd2-f717-4ca5-bfa0-9227322d1c60 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:42.386463 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-0d63bdd2-f717-4ca5-bfa0-9227322d1c60 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:42.395991 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-0d63bdd2-f717-4ca5-bfa0-9227322d1c60 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1574 microversion: 2.1 time: 0.190889 Jun 03 13:35:42.396628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 537/1165] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:42 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:43.416830 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-dce2690d-007e-447c-b9d5-326ad3fc2f47 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:43.417538 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-dce2690d-007e-447c-b9d5-326ad3fc2f47 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:43.424478 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dce2690d-007e-447c-b9d5-326ad3fc2f47 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:43.424972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dce2690d-007e-447c-b9d5-326ad3fc2f47 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:43.425740 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dce2690d-007e-447c-b9d5-326ad3fc2f47 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:43.426180 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dce2690d-007e-447c-b9d5-326ad3fc2f47 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:43.580862 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-dce2690d-007e-447c-b9d5-326ad3fc2f47 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:43.589623 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-dce2690d-007e-447c-b9d5-326ad3fc2f47 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1574 microversion: 2.1 time: 0.178371 Jun 03 13:35:43.595354 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 629/1166] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:43 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:44.613442 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-27754d3e-a727-4293-8af5-54cf1f44ec33 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:44.614072 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-27754d3e-a727-4293-8af5-54cf1f44ec33 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:44.621221 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-27754d3e-a727-4293-8af5-54cf1f44ec33 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:44.621667 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-27754d3e-a727-4293-8af5-54cf1f44ec33 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:44.622415 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-27754d3e-a727-4293-8af5-54cf1f44ec33 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:44.622849 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-27754d3e-a727-4293-8af5-54cf1f44ec33 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:44.849317 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-27754d3e-a727-4293-8af5-54cf1f44ec33 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:44.858619 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-27754d3e-a727-4293-8af5-54cf1f44ec33 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1456 microversion: 2.1 time: 0.247823 Jun 03 13:35:44.858619 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 538/1167] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:44 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1456 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:45.247645 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-0246fb63-2a03-406a-873f-56c2b5aa3c34 req-a3139b1b-b9eb-48ee-860a-6166aae2af42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8652e1dc-fa91-404d-9748-44c988f06a51", "name": "network-vif-deleted", "tag": "62634e0e-67f6-48f8-9f4a-af413bba9c4e"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:35:45.259217 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-0246fb63-2a03-406a-873f-56c2b5aa3c34 req-a3139b1b-b9eb-48ee-860a-6166aae2af42 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:45.259217 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-0246fb63-2a03-406a-873f-56c2b5aa3c34 req-a3139b1b-b9eb-48ee-860a-6166aae2af42 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:45.268600 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-0246fb63-2a03-406a-873f-56c2b5aa3c34 req-a3139b1b-b9eb-48ee-860a-6166aae2af42 service nova] Creating event network-vif-deleted:62634e0e-67f6-48f8-9f4a-af413bba9c4e for instance 8652e1dc-fa91-404d-9748-44c988f06a51 on hv-cinder-80135 Jun 03 13:35:45.273652 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-0246fb63-2a03-406a-873f-56c2b5aa3c34 req-a3139b1b-b9eb-48ee-860a-6166aae2af42 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029769 Jun 03 13:35:45.275202 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 630/1168] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:35:45.874019 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d7472664-4021-4352-be0b-fb440d728b3e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:45.874627 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d7472664-4021-4352-be0b-fb440d728b3e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:45.881162 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7472664-4021-4352-be0b-fb440d728b3e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:45.881675 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7472664-4021-4352-be0b-fb440d728b3e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:45.882806 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7472664-4021-4352-be0b-fb440d728b3e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:45.883944 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7472664-4021-4352-be0b-fb440d728b3e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:45.919323 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7472664-4021-4352-be0b-fb440d728b3e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:45.919778 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d7472664-4021-4352-be0b-fb440d728b3e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:45.920254 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-d7472664-4021-4352-be0b-fb440d728b3e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lazy-loading 'fault' on Instance uuid 8652e1dc-fa91-404d-9748-44c988f06a51 {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:35:45.965144 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d7472664-4021-4352-be0b-fb440d728b3e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:45.972565 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d7472664-4021-4352-be0b-fb440d728b3e tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 200 len: 1229 microversion: 2.1 time: 0.102393 Jun 03 13:35:45.973156 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 539/1169] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:45 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:46.990877 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-24ef4c64-66b9-4167-8938-67686258a47d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:46.991569 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-24ef4c64-66b9-4167-8938-67686258a47d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 8652e1dc-fa91-404d-9748-44c988f06a51] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:46.998800 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-24ef4c64-66b9-4167-8938-67686258a47d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:46.999252 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-24ef4c64-66b9-4167-8938-67686258a47d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:47.000069 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-24ef4c64-66b9-4167-8938-67686258a47d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:47.000545 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-24ef4c64-66b9-4167-8938-67686258a47d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:47.014563 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-24ef4c64-66b9-4167-8938-67686258a47d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] HTTP exception thrown: Instance 8652e1dc-fa91-404d-9748-44c988f06a51 could not be found. Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-24ef4c64-66b9-4167-8938-67686258a47d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Request method failure captured: Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 HTTP/1.1 Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgvyYA2IiU9TNANuA9VpS1K_dH6gWP_NNBA4PxyBqTO0jYJi3mQjFRQw1U2PEQnukK8FJQArs-iifZ6mwbFMyNOquvoO-6Q_Epk1eRiAorgp5JhpfBzUB2r-IkuxbuqGK9tFhoyYeA9iGqNg-sL6xhKxb1_vWNRyU0IzM0MLauoiOjE Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: c880a17cc9844081bee38006d5b92f86 Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-TestVolumeBootPattern-124618305 Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:35:47.016254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:35:47.018142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c880a17cc9844081bee38006d5b92f86", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:35:47.018142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-TestVolumeBootPattern-124618305 Jun 03 13:35:47.018142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: c880a17cc9844081bee38006d5b92f86 Jun 03 13:35:47.018142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-TestVolumeBootPattern-124618305 Jun 03 13:35:47.018142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-TestVolumeBootPattern-124618305-project Jun 03 13:35:47.018142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:35:47.018142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:35:47.018142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 77c56945d1d74a1eaa5e0c8f9e43f086 Jun 03 13:35:47.018142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-TestVolumeBootPattern-124618305-project Jun 03 13:35:47.018142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:35:47.018142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 8652e1dc-fa91-404d-9748-44c988f06a51 could not be found. Jun 03 13:35:47.018142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '8652e1dc-fa91-404d-9748-44c988f06a51'} Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8652e1dc-fa91-404d-9748-44c988f06a51 could not be found. Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:35:47.019228 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8652e1dc-fa91-404d-9748-44c988f06a51 could not be found. Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8652e1dc-fa91-404d-9748-44c988f06a51 could not be found. Jun 03 13:35:47.020996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:35:47.022508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-24ef4c64-66b9-4167-8938-67686258a47d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Returning 404 to user: Instance 8652e1dc-fa91-404d-9748-44c988f06a51 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:35:47.022508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-24ef4c64-66b9-4167-8938-67686258a47d tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51" status: 404 len: 111 microversion: 2.1 time: 0.031491 Jun 03 13:35:47.022508 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 631/1170] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:46 2022] GET /compute/v2.1/servers/8652e1dc-fa91-404d-9748-44c988f06a51 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:35:47.571983 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-7583ea9e-4e1d-429e-be2a-fb8530c53269 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f0a8190-6071-4b43-8dfe-350ce04c6ac2", "device": "/dev/sdb"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:35:47.583145 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-7583ea9e-4e1d-429e-be2a-fb8530c53269 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:47.583145 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7583ea9e-4e1d-429e-be2a-fb8530c53269 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:47.583145 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7583ea9e-4e1d-429e-be2a-fb8530c53269 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:47.583145 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7583ea9e-4e1d-429e-be2a-fb8530c53269 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:47.583545 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-7583ea9e-4e1d-429e-be2a-fb8530c53269 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:48.449156 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-7583ea9e-4e1d-429e-be2a-fb8530c53269 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "POST /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881645 Jun 03 13:35:48.449758 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 540/1171] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:35:47 2022] POST /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:35:50.341594 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-67039625-7cfe-4b96-ae46-351a0469f4df tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:50.342265 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-67039625-7cfe-4b96-ae46-351a0469f4df tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:50.349882 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67039625-7cfe-4b96-ae46-351a0469f4df tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:50.350383 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67039625-7cfe-4b96-ae46-351a0469f4df tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:50.351142 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67039625-7cfe-4b96-ae46-351a0469f4df tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:50.351736 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-67039625-7cfe-4b96-ae46-351a0469f4df tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:50.379396 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-67039625-7cfe-4b96-ae46-351a0469f4df tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Going to try to terminate instance {{(pid=118179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:35:50.409434 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-b76ddd4c-4468-4d7a-a647-7779dfa53473 req-3d36bcc3-7997-455b-80ae-7b809079f58a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3796fc8-4043-411c-8b2f-ab1a7c61b5d0", "tag": "71d01f9d-35f9-4b9d-88de-bce736f58304"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:35:50.419738 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-b76ddd4c-4468-4d7a-a647-7779dfa53473 req-3d36bcc3-7997-455b-80ae-7b809079f58a service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:50.420206 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-b76ddd4c-4468-4d7a-a647-7779dfa53473 req-3d36bcc3-7997-455b-80ae-7b809079f58a service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:50.432725 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-b76ddd4c-4468-4d7a-a647-7779dfa53473 req-3d36bcc3-7997-455b-80ae-7b809079f58a service nova] Creating event network-changed:71d01f9d-35f9-4b9d-88de-bce736f58304 for instance d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 on hv-cinder-80135 Jun 03 13:35:50.438051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-b76ddd4c-4468-4d7a-a647-7779dfa53473 req-3d36bcc3-7997-455b-80ae-7b809079f58a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098122 Jun 03 13:35:50.438585 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 541/1172] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:35:50.668213 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-67039625-7cfe-4b96-ae46-351a0469f4df tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 204 len: 0 microversion: 2.1 time: 0.330704 Jun 03 13:35:50.668799 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 632/1173] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:35:50 2022] DELETE /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:35:50.678022 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4925d651-9de5-4c03-ac58-01556f71e71a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:50.678729 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4925d651-9de5-4c03-ac58-01556f71e71a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:50.685619 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4925d651-9de5-4c03-ac58-01556f71e71a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:50.686071 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4925d651-9de5-4c03-ac58-01556f71e71a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:50.686987 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4925d651-9de5-4c03-ac58-01556f71e71a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:50.687425 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4925d651-9de5-4c03-ac58-01556f71e71a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:50.857946 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4925d651-9de5-4c03-ac58-01556f71e71a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:50.866666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4925d651-9de5-4c03-ac58-01556f71e71a tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1575 microversion: 2.1 time: 0.192975 Jun 03 13:35:50.867545 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 542/1174] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:50 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:51.885833 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a4c742d0-c7d7-449e-88cd-2d77907265c9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:51.886553 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a4c742d0-c7d7-449e-88cd-2d77907265c9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:51.893027 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a4c742d0-c7d7-449e-88cd-2d77907265c9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:51.893518 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a4c742d0-c7d7-449e-88cd-2d77907265c9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:51.894252 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a4c742d0-c7d7-449e-88cd-2d77907265c9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:51.894695 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a4c742d0-c7d7-449e-88cd-2d77907265c9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:52.004230 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a4c742d0-c7d7-449e-88cd-2d77907265c9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:52.013154 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a4c742d0-c7d7-449e-88cd-2d77907265c9 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1389 microversion: 2.1 time: 0.132570 Jun 03 13:35:52.023005 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 633/1175] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:51 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1389 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:52.024517 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-83f2f4c0-31d8-4ec5-b59e-2bc9272e13ba req-058abdb8-3c1f-41b0-94f4-576745548985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3796fc8-4043-411c-8b2f-ab1a7c61b5d0", "name": "network-vif-deleted", "tag": "71d01f9d-35f9-4b9d-88de-bce736f58304"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:35:52.034446 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-83f2f4c0-31d8-4ec5-b59e-2bc9272e13ba req-058abdb8-3c1f-41b0-94f4-576745548985 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:52.040191 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-83f2f4c0-31d8-4ec5-b59e-2bc9272e13ba req-058abdb8-3c1f-41b0-94f4-576745548985 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:52.046918 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-83f2f4c0-31d8-4ec5-b59e-2bc9272e13ba req-058abdb8-3c1f-41b0-94f4-576745548985 service nova] Creating event network-vif-deleted:71d01f9d-35f9-4b9d-88de-bce736f58304 for instance d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 on hv-cinder-80135 Jun 03 13:35:52.051816 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-83f2f4c0-31d8-4ec5-b59e-2bc9272e13ba req-058abdb8-3c1f-41b0-94f4-576745548985 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031329 Jun 03 13:35:52.052748 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 543/1176] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:35:53.030882 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-0da77bc2-e117-4703-95e4-5d148a05f737 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:53.032175 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-0da77bc2-e117-4703-95e4-5d148a05f737 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:53.038616 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0da77bc2-e117-4703-95e4-5d148a05f737 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:53.040374 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0da77bc2-e117-4703-95e4-5d148a05f737 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:53.040374 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0da77bc2-e117-4703-95e4-5d148a05f737 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:53.040955 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0da77bc2-e117-4703-95e4-5d148a05f737 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:53.071154 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0da77bc2-e117-4703-95e4-5d148a05f737 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:53.071606 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-0da77bc2-e117-4703-95e4-5d148a05f737 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:53.074902 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-0da77bc2-e117-4703-95e4-5d148a05f737 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lazy-loading 'fault' on Instance uuid d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:35:53.117368 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-0da77bc2-e117-4703-95e4-5d148a05f737 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c56945d1d74a1eaa5e0c8f9e43f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c880a17cc9844081bee38006d5b92f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:53.124771 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-0da77bc2-e117-4703-95e4-5d148a05f737 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 200 len: 1229 microversion: 2.1 time: 0.097794 Jun 03 13:35:53.125337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 634/1177] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:53 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:53.259606 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-efd5b852-ae4d-4cc7-a7ca-03ff2912199f tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:35:53.260169 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-efd5b852-ae4d-4cc7-a7ca-03ff2912199f tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:53.266378 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-efd5b852-ae4d-4cc7-a7ca-03ff2912199f tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:53.267030 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-efd5b852-ae4d-4cc7-a7ca-03ff2912199f tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:53.267726 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-efd5b852-ae4d-4cc7-a7ca-03ff2912199f tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:53.268178 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-efd5b852-ae4d-4cc7-a7ca-03ff2912199f tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:53.292770 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-efd5b852-ae4d-4cc7-a7ca-03ff2912199f tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lazy-loading 'flavor' on Instance uuid 5e599e23-8550-45f3-aa57-3a875f922883 {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:35:53.574678 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-efd5b852-ae4d-4cc7-a7ca-03ff2912199f tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "POST /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883/action" status: 202 len: 0 microversion: 2.1 time: 0.320576 Jun 03 13:35:53.575181 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 544/1178] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:35:53 2022] POST /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:35:53.583447 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-dbfdb9e0-b039-4d3a-b920-d3d299fe7ab9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:53.584259 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-dbfdb9e0-b039-4d3a-b920-d3d299fe7ab9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:53.591135 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dbfdb9e0-b039-4d3a-b920-d3d299fe7ab9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:53.591672 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dbfdb9e0-b039-4d3a-b920-d3d299fe7ab9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:53.592584 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dbfdb9e0-b039-4d3a-b920-d3d299fe7ab9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:53.593026 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dbfdb9e0-b039-4d3a-b920-d3d299fe7ab9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:53.725673 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-dbfdb9e0-b039-4d3a-b920-d3d299fe7ab9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:53.733376 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-dbfdb9e0-b039-4d3a-b920-d3d299fe7ab9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.153899 Jun 03 13:35:53.733947 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 635/1179] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:53 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:54.142256 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-861911a9-4537-43c4-a6d2-38f8130514b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:54.142897 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-861911a9-4537-43c4-a6d2-38f8130514b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: d3796fc8-4043-411c-8b2f-ab1a7c61b5d0] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:54.149224 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-861911a9-4537-43c4-a6d2-38f8130514b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:54.149621 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-861911a9-4537-43c4-a6d2-38f8130514b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:54.150373 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-861911a9-4537-43c4-a6d2-38f8130514b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:54.150801 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-861911a9-4537-43c4-a6d2-38f8130514b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:54.163918 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-861911a9-4537-43c4-a6d2-38f8130514b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] HTTP exception thrown: Instance d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 could not be found. Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-861911a9-4537-43c4-a6d2-38f8130514b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Request method failure captured: Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 HTTP/1.1 Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgvyYA2IiU9TNANuA9VpS1K_dH6gWP_NNBA4PxyBqTO0jYJi3mQjFRQw1U2PEQnukK8FJQArs-iifZ6mwbFMyNOquvoO-6Q_Epk1eRiAorgp5JhpfBzUB2r-IkuxbuqGK9tFhoyYeA9iGqNg-sL6xhKxb1_vWNRyU0IzM0MLauoiOjE Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: c880a17cc9844081bee38006d5b92f86 Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-TestVolumeBootPattern-124618305 Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:35:54.166319 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:35:54.168014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c880a17cc9844081bee38006d5b92f86", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:35:54.168014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-TestVolumeBootPattern-124618305 Jun 03 13:35:54.168014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: c880a17cc9844081bee38006d5b92f86 Jun 03 13:35:54.168014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-TestVolumeBootPattern-124618305 Jun 03 13:35:54.168014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-TestVolumeBootPattern-124618305-project Jun 03 13:35:54.168014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:35:54.168014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:35:54.168014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 77c56945d1d74a1eaa5e0c8f9e43f086 Jun 03 13:35:54.168014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-TestVolumeBootPattern-124618305-project Jun 03 13:35:54.168014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:35:54.168014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 could not be found. Jun 03 13:35:54.168014 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': 'd3796fc8-4043-411c-8b2f-ab1a7c61b5d0'} Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 could not be found. Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:35:54.168989 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 could not be found. Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 could not be found. Jun 03 13:35:54.170536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:35:54.171986 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-861911a9-4537-43c4-a6d2-38f8130514b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Returning 404 to user: Instance d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:35:54.171986 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-861911a9-4537-43c4-a6d2-38f8130514b3 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0" status: 404 len: 111 microversion: 2.1 time: 0.029731 Jun 03 13:35:54.171986 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 545/1180] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:54 2022] GET /compute/v2.1/servers/d3796fc8-4043-411c-8b2f-ab1a7c61b5d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:35:54.751896 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-a0503fb3-4e25-462b-92fd-dfc485aab9c0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:54.752655 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-a0503fb3-4e25-462b-92fd-dfc485aab9c0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:54.759980 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a0503fb3-4e25-462b-92fd-dfc485aab9c0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:54.760464 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a0503fb3-4e25-462b-92fd-dfc485aab9c0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:54.761224 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a0503fb3-4e25-462b-92fd-dfc485aab9c0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:54.761662 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-a0503fb3-4e25-462b-92fd-dfc485aab9c0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:54.972748 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-014a4ef7-f38c-41a9-95dd-58649fa6db68 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:54.973236 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-a0503fb3-4e25-462b-92fd-dfc485aab9c0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:54.973351 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-014a4ef7-f38c-41a9-95dd-58649fa6db68 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:54.980788 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-014a4ef7-f38c-41a9-95dd-58649fa6db68 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:54.981102 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-a0503fb3-4e25-462b-92fd-dfc485aab9c0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.233020 Jun 03 13:35:54.981235 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-014a4ef7-f38c-41a9-95dd-58649fa6db68 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:54.981679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 636/1181] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:54 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:54.982005 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-014a4ef7-f38c-41a9-95dd-58649fa6db68 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:54.982483 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-014a4ef7-f38c-41a9-95dd-58649fa6db68 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:54.997206 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-014a4ef7-f38c-41a9-95dd-58649fa6db68 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] HTTP exception thrown: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-014a4ef7-f38c-41a9-95dd-58649fa6db68 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Request method failure captured: Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: DELETE /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 HTTP/1.1 Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimgvyYA2IiU9TNANuA9VpS1K_dH6gWP_NNBA4PxyBqTO0jYJi3mQjFRQw1U2PEQnukK8FJQArs-iifZ6mwbFMyNOquvoO-6Q_Epk1eRiAorgp5JhpfBzUB2r-IkuxbuqGK9tFhoyYeA9iGqNg-sL6xhKxb1_vWNRyU0IzM0MLauoiOjE Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: c880a17cc9844081bee38006d5b92f86 Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-TestVolumeBootPattern-124618305 Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:35:54.998823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:35:55.000249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c880a17cc9844081bee38006d5b92f86", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:35:55.000249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-TestVolumeBootPattern-124618305 Jun 03 13:35:55.000249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: c880a17cc9844081bee38006d5b92f86 Jun 03 13:35:55.000249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-TestVolumeBootPattern-124618305 Jun 03 13:35:55.000249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-TestVolumeBootPattern-124618305-project Jun 03 13:35:55.000249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:35:55.000249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:35:55.000249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 77c56945d1d74a1eaa5e0c8f9e43f086 Jun 03 13:35:55.000249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-TestVolumeBootPattern-124618305-project Jun 03 13:35:55.000249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:35:55.000249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:35:55.000249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '948a342e-2849-416a-a15b-86ca72bb08d7'} Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:35:55.001040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:35:55.002839 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:35:55.004716 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-014a4ef7-f38c-41a9-95dd-58649fa6db68 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Returning 404 to user: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:35:55.004716 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-014a4ef7-f38c-41a9-95dd-58649fa6db68 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 404 len: 111 microversion: 2.1 time: 0.031411 Jun 03 13:35:55.004716 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 546/1182] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:35:54 2022] DELETE /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:35:55.010064 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-03692875-04a9-4524-9393-75a89d639639 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:55.010693 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-03692875-04a9-4524-9393-75a89d639639 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] [instance: 948a342e-2849-416a-a15b-86ca72bb08d7] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:55.016895 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-03692875-04a9-4524-9393-75a89d639639 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:55.022873 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-03692875-04a9-4524-9393-75a89d639639 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:55.022873 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-03692875-04a9-4524-9393-75a89d639639 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:55.022873 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-03692875-04a9-4524-9393-75a89d639639 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:55.032111 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-03692875-04a9-4524-9393-75a89d639639 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] HTTP exception thrown: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-03692875-04a9-4524-9393-75a89d639639 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Request method failure captured: Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 HTTP/1.1 Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimgvyYA2IiU9TNANuA9VpS1K_dH6gWP_NNBA4PxyBqTO0jYJi3mQjFRQw1U2PEQnukK8FJQArs-iifZ6mwbFMyNOquvoO-6Q_Epk1eRiAorgp5JhpfBzUB2r-IkuxbuqGK9tFhoyYeA9iGqNg-sL6xhKxb1_vWNRyU0IzM0MLauoiOjE Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: c880a17cc9844081bee38006d5b92f86 Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-TestVolumeBootPattern-124618305 Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:35:55.033791 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:35:55.035440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c880a17cc9844081bee38006d5b92f86", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c880a17cc9844081bee38006d5b92f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:35:55.035440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-TestVolumeBootPattern-124618305 Jun 03 13:35:55.035440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: c880a17cc9844081bee38006d5b92f86 Jun 03 13:35:55.035440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-TestVolumeBootPattern-124618305 Jun 03 13:35:55.035440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-TestVolumeBootPattern-124618305-project Jun 03 13:35:55.035440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:35:55.035440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:35:55.035440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 77c56945d1d74a1eaa5e0c8f9e43f086 Jun 03 13:35:55.035440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-TestVolumeBootPattern-124618305-project Jun 03 13:35:55.035440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:35:55.035440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:35:55.035440 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '948a342e-2849-416a-a15b-86ca72bb08d7'} Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:35:55.036341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. Jun 03 13:35:55.037690 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:35:55.038906 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-03692875-04a9-4524-9393-75a89d639639 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Returning 404 to user: Instance 948a342e-2849-416a-a15b-86ca72bb08d7 could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:35:55.038906 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-03692875-04a9-4524-9393-75a89d639639 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7" status: 404 len: 111 microversion: 2.1 time: 0.030086 Jun 03 13:35:55.038906 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 637/1183] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:55 2022] GET /compute/v2.1/servers/948a342e-2849-416a-a15b-86ca72bb08d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:35:55.998695 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c3642bce-dc88-4f0c-b81f-384bd2b7aa65 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:55.999313 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-c3642bce-dc88-4f0c-b81f-384bd2b7aa65 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:56.006185 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c3642bce-dc88-4f0c-b81f-384bd2b7aa65 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:56.006637 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c3642bce-dc88-4f0c-b81f-384bd2b7aa65 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:56.007664 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c3642bce-dc88-4f0c-b81f-384bd2b7aa65 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:56.008856 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c3642bce-dc88-4f0c-b81f-384bd2b7aa65 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:56.142906 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c3642bce-dc88-4f0c-b81f-384bd2b7aa65 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:56.150473 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c3642bce-dc88-4f0c-b81f-384bd2b7aa65 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.155666 Jun 03 13:35:56.151052 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 547/1184] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:55 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:56.579891 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-f8892476-5f82-4441-b5ef-2d706bbf03b6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] Calling method '.version_select at 0x7f5bca7e0940>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:56.696937 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-f8892476-5f82-4441-b5ef-2d706bbf03b6 tempest-TestVolumeBootPattern-124618305 tempest-TestVolumeBootPattern-124618305-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-453693398" status: 202 len: 0 microversion: 2.1 time: 0.120839 Jun 03 13:35:56.697456 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 638/1185] 10.222.0.61 () {58 vars in 1259 bytes} [Fri Jun 3 13:35:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-453693398 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:35:57.167834 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d340f489-4643-41a3-b4e9-7b144c8a342e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:57.168413 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d340f489-4643-41a3-b4e9-7b144c8a342e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:57.175312 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d340f489-4643-41a3-b4e9-7b144c8a342e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:57.176101 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d340f489-4643-41a3-b4e9-7b144c8a342e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:57.176966 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d340f489-4643-41a3-b4e9-7b144c8a342e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:57.177471 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d340f489-4643-41a3-b4e9-7b144c8a342e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:57.312203 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d340f489-4643-41a3-b4e9-7b144c8a342e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:57.319909 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d340f489-4643-41a3-b4e9-7b144c8a342e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.156426 Jun 03 13:35:57.320515 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 548/1186] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:57 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:58.339737 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5f9c6d95-b1e4-4380-8177-f944389d98da tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:58.342305 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5f9c6d95-b1e4-4380-8177-f944389d98da tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:58.348446 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5f9c6d95-b1e4-4380-8177-f944389d98da tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:58.349036 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5f9c6d95-b1e4-4380-8177-f944389d98da tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:58.349879 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5f9c6d95-b1e4-4380-8177-f944389d98da tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:58.350383 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5f9c6d95-b1e4-4380-8177-f944389d98da tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:58.488578 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5f9c6d95-b1e4-4380-8177-f944389d98da tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:58.496996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5f9c6d95-b1e4-4380-8177-f944389d98da tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.163225 Jun 03 13:35:58.497551 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 639/1187] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:58 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:35:59.515317 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c97c01ad-16a8-4740-820c-92debda1b67d tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:35:59.518469 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-c97c01ad-16a8-4740-820c-92debda1b67d tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:35:59.522387 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c97c01ad-16a8-4740-820c-92debda1b67d tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:59.523089 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c97c01ad-16a8-4740-820c-92debda1b67d tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:59.523873 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c97c01ad-16a8-4740-820c-92debda1b67d tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:35:59.524593 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c97c01ad-16a8-4740-820c-92debda1b67d tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:35:59.730050 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c97c01ad-16a8-4740-820c-92debda1b67d tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:35:59.750114 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c97c01ad-16a8-4740-820c-92debda1b67d tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.239567 Jun 03 13:35:59.751968 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 549/1188] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:35:59 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:00.770127 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-94ffc171-54c5-49af-bb70-6ec287fd13a9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:00.770738 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-94ffc171-54c5-49af-bb70-6ec287fd13a9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:00.777379 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-94ffc171-54c5-49af-bb70-6ec287fd13a9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:00.777829 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-94ffc171-54c5-49af-bb70-6ec287fd13a9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:00.778599 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-94ffc171-54c5-49af-bb70-6ec287fd13a9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:00.779035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-94ffc171-54c5-49af-bb70-6ec287fd13a9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:00.998012 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-94ffc171-54c5-49af-bb70-6ec287fd13a9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:01.005927 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-94ffc171-54c5-49af-bb70-6ec287fd13a9 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.239674 Jun 03 13:36:01.006506 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 640/1189] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:00 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:02.022713 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-fc40f509-8a6d-412c-8d8c-1bd9e5a0a417 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:02.023358 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-fc40f509-8a6d-412c-8d8c-1bd9e5a0a417 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:02.031596 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fc40f509-8a6d-412c-8d8c-1bd9e5a0a417 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:02.032051 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fc40f509-8a6d-412c-8d8c-1bd9e5a0a417 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:02.032861 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fc40f509-8a6d-412c-8d8c-1bd9e5a0a417 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:02.033303 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fc40f509-8a6d-412c-8d8c-1bd9e5a0a417 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:02.193805 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-fc40f509-8a6d-412c-8d8c-1bd9e5a0a417 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:02.202140 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-fc40f509-8a6d-412c-8d8c-1bd9e5a0a417 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.183236 Jun 03 13:36:02.203308 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 550/1190] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:02 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:03.219639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-071095a9-c662-411a-98b5-5249709c6094 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:03.220869 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-071095a9-c662-411a-98b5-5249709c6094 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:03.227572 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-071095a9-c662-411a-98b5-5249709c6094 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:03.229137 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-071095a9-c662-411a-98b5-5249709c6094 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:03.230084 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-071095a9-c662-411a-98b5-5249709c6094 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:03.230688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-071095a9-c662-411a-98b5-5249709c6094 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:03.422087 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-071095a9-c662-411a-98b5-5249709c6094 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:03.433526 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-071095a9-c662-411a-98b5-5249709c6094 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.217884 Jun 03 13:36:03.434397 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 641/1191] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:03 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:04.450753 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-97b7ba08-6642-4ec9-bbc5-0a47c54f36ea tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:04.451395 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-97b7ba08-6642-4ec9-bbc5-0a47c54f36ea tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:04.457844 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-97b7ba08-6642-4ec9-bbc5-0a47c54f36ea tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:04.458291 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-97b7ba08-6642-4ec9-bbc5-0a47c54f36ea tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:04.459055 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-97b7ba08-6642-4ec9-bbc5-0a47c54f36ea tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:04.459492 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-97b7ba08-6642-4ec9-bbc5-0a47c54f36ea tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:04.601711 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-97b7ba08-6642-4ec9-bbc5-0a47c54f36ea tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:04.609618 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-97b7ba08-6642-4ec9-bbc5-0a47c54f36ea tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.162622 Jun 03 13:36:04.610268 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 551/1192] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:04 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:05.626726 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-df9a2854-6a33-4253-9cf2-4a31d07d49f5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:05.627333 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-df9a2854-6a33-4253-9cf2-4a31d07d49f5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:05.634748 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-df9a2854-6a33-4253-9cf2-4a31d07d49f5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:05.635196 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-df9a2854-6a33-4253-9cf2-4a31d07d49f5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:05.635968 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-df9a2854-6a33-4253-9cf2-4a31d07d49f5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:05.636590 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-df9a2854-6a33-4253-9cf2-4a31d07d49f5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:05.770404 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-df9a2854-6a33-4253-9cf2-4a31d07d49f5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:05.778365 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-df9a2854-6a33-4253-9cf2-4a31d07d49f5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.155490 Jun 03 13:36:05.778935 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 642/1193] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:05 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:06.795794 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e71e6199-c8d8-4db6-b4e8-ff7714ab9448 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:06.796440 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e71e6199-c8d8-4db6-b4e8-ff7714ab9448 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:06.802985 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e71e6199-c8d8-4db6-b4e8-ff7714ab9448 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:06.803437 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e71e6199-c8d8-4db6-b4e8-ff7714ab9448 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:06.804233 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e71e6199-c8d8-4db6-b4e8-ff7714ab9448 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:06.804678 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e71e6199-c8d8-4db6-b4e8-ff7714ab9448 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:06.809427 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:06.934410 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e71e6199-c8d8-4db6-b4e8-ff7714ab9448 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:06.941827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e71e6199-c8d8-4db6-b4e8-ff7714ab9448 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.150006 Jun 03 13:36:06.942391 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 552/1194] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:06 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:07.959254 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-dff52e80-af5e-4c6c-9caa-80bf77e2a970 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:07.960999 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-dff52e80-af5e-4c6c-9caa-80bf77e2a970 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:07.967011 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dff52e80-af5e-4c6c-9caa-80bf77e2a970 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:07.967458 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dff52e80-af5e-4c6c-9caa-80bf77e2a970 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:07.968341 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dff52e80-af5e-4c6c-9caa-80bf77e2a970 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:07.968784 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-dff52e80-af5e-4c6c-9caa-80bf77e2a970 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:08.105343 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-dff52e80-af5e-4c6c-9caa-80bf77e2a970 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:08.109097 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:08.113614 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-dff52e80-af5e-4c6c-9caa-80bf77e2a970 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.158409 Jun 03 13:36:08.114186 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 643/1195] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:07 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:09.130739 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-c82b0420-cb84-4f50-b4c2-eaa8a2fa97b1 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:09.131347 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-c82b0420-cb84-4f50-b4c2-eaa8a2fa97b1 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:09.138709 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c82b0420-cb84-4f50-b4c2-eaa8a2fa97b1 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:09.139162 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c82b0420-cb84-4f50-b4c2-eaa8a2fa97b1 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:09.139946 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c82b0420-cb84-4f50-b4c2-eaa8a2fa97b1 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:09.140403 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-c82b0420-cb84-4f50-b4c2-eaa8a2fa97b1 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:09.274047 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-c82b0420-cb84-4f50-b4c2-eaa8a2fa97b1 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:09.281668 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-c82b0420-cb84-4f50-b4c2-eaa8a2fa97b1 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.154790 Jun 03 13:36:09.282230 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 553/1196] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:09 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:10.298609 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5197cbb1-c7fb-43ff-9357-6c95c704ce47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:10.299162 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5197cbb1-c7fb-43ff-9357-6c95c704ce47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:10.305793 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5197cbb1-c7fb-43ff-9357-6c95c704ce47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:10.306237 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5197cbb1-c7fb-43ff-9357-6c95c704ce47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:10.307716 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5197cbb1-c7fb-43ff-9357-6c95c704ce47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:10.308129 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5197cbb1-c7fb-43ff-9357-6c95c704ce47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:10.438773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5197cbb1-c7fb-43ff-9357-6c95c704ce47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:10.446277 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5197cbb1-c7fb-43ff-9357-6c95c704ce47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.151937 Jun 03 13:36:10.446818 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 644/1197] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:10 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:11.464549 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-d2f1986e-a575-414b-9b9c-4a133fa2cece tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:11.465162 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-d2f1986e-a575-414b-9b9c-4a133fa2cece tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:11.471890 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d2f1986e-a575-414b-9b9c-4a133fa2cece tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:11.472369 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d2f1986e-a575-414b-9b9c-4a133fa2cece tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:11.473124 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d2f1986e-a575-414b-9b9c-4a133fa2cece tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:11.473554 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-d2f1986e-a575-414b-9b9c-4a133fa2cece tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:11.602792 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-d2f1986e-a575-414b-9b9c-4a133fa2cece tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:11.610829 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-d2f1986e-a575-414b-9b9c-4a133fa2cece tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.150968 Jun 03 13:36:11.611397 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 554/1198] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:11 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:12.627908 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-04e1849b-7d2b-4cae-9ba7-55954706eb88 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:12.628608 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-04e1849b-7d2b-4cae-9ba7-55954706eb88 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:12.631055 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:12.636216 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-04e1849b-7d2b-4cae-9ba7-55954706eb88 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:12.636664 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-04e1849b-7d2b-4cae-9ba7-55954706eb88 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:12.637449 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-04e1849b-7d2b-4cae-9ba7-55954706eb88 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:12.637881 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-04e1849b-7d2b-4cae-9ba7-55954706eb88 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:12.769183 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-04e1849b-7d2b-4cae-9ba7-55954706eb88 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:12.777239 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-04e1849b-7d2b-4cae-9ba7-55954706eb88 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.153275 Jun 03 13:36:12.777803 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 645/1199] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:12 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:13.795056 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-e64a5f0d-f8a4-4d23-8f12-1f38a59f35d0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:13.795674 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-e64a5f0d-f8a4-4d23-8f12-1f38a59f35d0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:13.798165 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=41 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:13.803059 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e64a5f0d-f8a4-4d23-8f12-1f38a59f35d0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:13.803561 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e64a5f0d-f8a4-4d23-8f12-1f38a59f35d0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:13.804381 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e64a5f0d-f8a4-4d23-8f12-1f38a59f35d0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:13.804828 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-e64a5f0d-f8a4-4d23-8f12-1f38a59f35d0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:13.946112 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-e64a5f0d-f8a4-4d23-8f12-1f38a59f35d0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:13.953673 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-e64a5f0d-f8a4-4d23-8f12-1f38a59f35d0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.163610 Jun 03 13:36:13.955524 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 555/1200] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:13 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:14.981293 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-728b87bd-8e3d-47c3-b884-db9e03273abf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:14.981293 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-728b87bd-8e3d-47c3-b884-db9e03273abf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:14.981293 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-728b87bd-8e3d-47c3-b884-db9e03273abf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:14.981293 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-728b87bd-8e3d-47c3-b884-db9e03273abf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:14.982730 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-728b87bd-8e3d-47c3-b884-db9e03273abf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:14.982730 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-728b87bd-8e3d-47c3-b884-db9e03273abf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:15.127684 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-728b87bd-8e3d-47c3-b884-db9e03273abf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:15.135893 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-728b87bd-8e3d-47c3-b884-db9e03273abf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.168904 Jun 03 13:36:15.136554 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 646/1201] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:14 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:16.154020 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6c8c2a22-4def-4174-909b-d7b366187dc6 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:16.154633 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6c8c2a22-4def-4174-909b-d7b366187dc6 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:16.163668 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6c8c2a22-4def-4174-909b-d7b366187dc6 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:16.163668 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6c8c2a22-4def-4174-909b-d7b366187dc6 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:16.163668 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6c8c2a22-4def-4174-909b-d7b366187dc6 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:16.163668 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6c8c2a22-4def-4174-909b-d7b366187dc6 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:16.442244 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-6c8c2a22-4def-4174-909b-d7b366187dc6 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:16.442244 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6c8c2a22-4def-4174-909b-d7b366187dc6 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1567 microversion: 2.1 time: 0.171818 Jun 03 13:36:16.442244 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 556/1202] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:16 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:16.443232 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6b911f10-48cf-45ff-ab04-4b644f0c70bf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:36:16.443232 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6b911f10-48cf-45ff-ab04-4b644f0c70bf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:16.443232 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6b911f10-48cf-45ff-ab04-4b644f0c70bf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:16.443232 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6b911f10-48cf-45ff-ab04-4b644f0c70bf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:16.443962 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6b911f10-48cf-45ff-ab04-4b644f0c70bf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:16.443962 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6b911f10-48cf-45ff-ab04-4b644f0c70bf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:16.681273 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6b911f10-48cf-45ff-ab04-4b644f0c70bf tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "POST /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883/action" status: 202 len: 0 microversion: 2.1 time: 0.346509 Jun 03 13:36:16.681971 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 647/1203] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 13:36:16 2022] POST /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:36:16.691010 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-88f8a2ce-667b-4d9b-8d5b-e4df7326ec24 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:16.691624 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-88f8a2ce-667b-4d9b-8d5b-e4df7326ec24 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:16.697719 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-88f8a2ce-667b-4d9b-8d5b-e4df7326ec24 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:16.698256 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-88f8a2ce-667b-4d9b-8d5b-e4df7326ec24 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:16.699040 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-88f8a2ce-667b-4d9b-8d5b-e4df7326ec24 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:16.699454 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-88f8a2ce-667b-4d9b-8d5b-e4df7326ec24 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:16.831888 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-88f8a2ce-667b-4d9b-8d5b-e4df7326ec24 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:16.840160 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-88f8a2ce-667b-4d9b-8d5b-e4df7326ec24 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1515 microversion: 2.1 time: 0.153162 Jun 03 13:36:16.842485 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 557/1204] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:16 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:17.300208 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-639d033d-6ddf-4c54-a0cf-f065b2908dbf tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:17.300715 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-639d033d-6ddf-4c54-a0cf-f065b2908dbf tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:17.307028 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-639d033d-6ddf-4c54-a0cf-f065b2908dbf tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:17.307478 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-639d033d-6ddf-4c54-a0cf-f065b2908dbf tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:17.308381 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-639d033d-6ddf-4c54-a0cf-f065b2908dbf tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:17.308819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-639d033d-6ddf-4c54-a0cf-f065b2908dbf tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:17.395741 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-639d033d-6ddf-4c54-a0cf-f065b2908dbf tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lazy-loading 'services' on Instance uuid c1980447-8506-4fc9-a363-b193f15aa056 {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:36:17.599743 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-639d033d-6ddf-4c54-a0cf-f065b2908dbf tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056/os-volume_attachments/0f0a8190-6071-4b43-8dfe-350ce04c6ac2" status: 202 len: 0 microversion: 2.1 time: 0.303296 Jun 03 13:36:17.600711 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 648/1205] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 13:36:17 2022] DELETE /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056/os-volume_attachments/0f0a8190-6071-4b43-8dfe-350ce04c6ac2 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:36:17.857798 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-17d9c3b7-7b80-454a-a029-2ba210b5cdd3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:17.858740 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-17d9c3b7-7b80-454a-a029-2ba210b5cdd3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:17.865166 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-17d9c3b7-7b80-454a-a029-2ba210b5cdd3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:17.865627 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-17d9c3b7-7b80-454a-a029-2ba210b5cdd3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:17.866391 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-17d9c3b7-7b80-454a-a029-2ba210b5cdd3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:17.866830 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-17d9c3b7-7b80-454a-a029-2ba210b5cdd3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:17.941913 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-fffd28e5-2148-41fe-8e42-28cac80c97c0 req-28e64c42-439f-451c-b2b9-02e746e82ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e599e23-8550-45f3-aa57-3a875f922883", "name": "network-vif-unplugged", "status": "completed", "tag": "14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:36:17.955123 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-fffd28e5-2148-41fe-8e42-28cac80c97c0 req-28e64c42-439f-451c-b2b9-02e746e82ad2 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:17.955123 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-fffd28e5-2148-41fe-8e42-28cac80c97c0 req-28e64c42-439f-451c-b2b9-02e746e82ad2 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:17.962855 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.compute.server_external_events [req-fffd28e5-2148-41fe-8e42-28cac80c97c0 req-28e64c42-439f-451c-b2b9-02e746e82ad2 service nova] Unable to find a host for instance 5e599e23-8550-45f3-aa57-3a875f922883. Dropping event network-vif-unplugged {{(pid=118179) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 03 13:36:17.964651 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-fffd28e5-2148-41fe-8e42-28cac80c97c0 req-28e64c42-439f-451c-b2b9-02e746e82ad2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027198 Jun 03 13:36:17.965325 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 649/1206] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 03 13:36:18.002564 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-17d9c3b7-7b80-454a-a029-2ba210b5cdd3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:18.010646 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-17d9c3b7-7b80-454a-a029-2ba210b5cdd3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1515 microversion: 2.1 time: 0.157479 Jun 03 13:36:18.011271 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 558/1207] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:17 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:18.720430 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ceacd8c2-04f2-4613-941f-6d428b1b48d6 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:18.723454 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ceacd8c2-04f2-4613-941f-6d428b1b48d6 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:18.727519 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ceacd8c2-04f2-4613-941f-6d428b1b48d6 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:18.728004 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ceacd8c2-04f2-4613-941f-6d428b1b48d6 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:18.728797 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ceacd8c2-04f2-4613-941f-6d428b1b48d6 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:18.729234 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ceacd8c2-04f2-4613-941f-6d428b1b48d6 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:18.754352 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ceacd8c2-04f2-4613-941f-6d428b1b48d6 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Going to try to terminate instance {{(pid=118179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:36:19.027986 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4eca4c95-3ccd-46c7-9a07-0f4c0bcacf5c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:19.030417 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4eca4c95-3ccd-46c7-9a07-0f4c0bcacf5c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:19.035247 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4eca4c95-3ccd-46c7-9a07-0f4c0bcacf5c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:19.035703 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4eca4c95-3ccd-46c7-9a07-0f4c0bcacf5c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:19.036608 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4eca4c95-3ccd-46c7-9a07-0f4c0bcacf5c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:19.037032 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4eca4c95-3ccd-46c7-9a07-0f4c0bcacf5c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:19.050126 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ceacd8c2-04f2-4613-941f-6d428b1b48d6 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 204 len: 0 microversion: 2.1 time: 0.333258 Jun 03 13:36:19.051401 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 650/1208] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:36:18 2022] DELETE /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:36:19.060691 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-93fe7a95-d5bc-427a-9eaf-a6612391f9fa tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:19.061393 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-93fe7a95-d5bc-427a-9eaf-a6612391f9fa tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:19.067447 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-93fe7a95-d5bc-427a-9eaf-a6612391f9fa tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:19.067900 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-93fe7a95-d5bc-427a-9eaf-a6612391f9fa tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:19.068696 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-93fe7a95-d5bc-427a-9eaf-a6612391f9fa tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:19.069140 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-93fe7a95-d5bc-427a-9eaf-a6612391f9fa tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:19.177145 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4eca4c95-3ccd-46c7-9a07-0f4c0bcacf5c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:19.183785 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4eca4c95-3ccd-46c7-9a07-0f4c0bcacf5c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1517 microversion: 2.1 time: 0.160232 Jun 03 13:36:19.184402 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 559/1209] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:19 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:36:19.200493 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-93fe7a95-d5bc-427a-9eaf-a6612391f9fa tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:19.208001 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-93fe7a95-d5bc-427a-9eaf-a6612391f9fa tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1513 microversion: 2.1 time: 0.152471 Jun 03 13:36:19.208589 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 651/1210] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:19 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:36:20.201872 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-93a915ac-defe-48c8-ada4-5fb4da38b5fd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:20.202465 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-93a915ac-defe-48c8-ada4-5fb4da38b5fd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:20.208949 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-93a915ac-defe-48c8-ada4-5fb4da38b5fd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:20.209400 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-93a915ac-defe-48c8-ada4-5fb4da38b5fd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:20.210163 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-93a915ac-defe-48c8-ada4-5fb4da38b5fd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:20.210599 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-93a915ac-defe-48c8-ada4-5fb4da38b5fd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:20.225592 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-bc8a7aca-2df8-4529-9b18-fea4bdcdec45 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:20.226218 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-bc8a7aca-2df8-4529-9b18-fea4bdcdec45 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:20.233090 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bc8a7aca-2df8-4529-9b18-fea4bdcdec45 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:20.233549 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bc8a7aca-2df8-4529-9b18-fea4bdcdec45 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:20.234346 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bc8a7aca-2df8-4529-9b18-fea4bdcdec45 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:20.234800 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-bc8a7aca-2df8-4529-9b18-fea4bdcdec45 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:20.345357 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-93a915ac-defe-48c8-ada4-5fb4da38b5fd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:20.354595 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-93a915ac-defe-48c8-ada4-5fb4da38b5fd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1517 microversion: 2.1 time: 0.156558 Jun 03 13:36:20.361178 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 560/1211] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:20 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:20.384226 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-bc8a7aca-2df8-4529-9b18-fea4bdcdec45 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:20.384226 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-bc8a7aca-2df8-4529-9b18-fea4bdcdec45 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1513 microversion: 2.1 time: 0.155545 Jun 03 13:36:20.384226 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 652/1212] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:20 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:36:21.371357 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-251e7b44-6287-4356-bd68-e3146ab94ea2 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:21.372018 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-251e7b44-6287-4356-bd68-e3146ab94ea2 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:21.386076 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-251e7b44-6287-4356-bd68-e3146ab94ea2 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:21.386076 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-251e7b44-6287-4356-bd68-e3146ab94ea2 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:21.386076 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-251e7b44-6287-4356-bd68-e3146ab94ea2 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:21.386076 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-251e7b44-6287-4356-bd68-e3146ab94ea2 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:21.399901 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-696b08ad-df82-4036-b931-fb59b6c8c706 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:21.403026 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-696b08ad-df82-4036-b931-fb59b6c8c706 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:21.409754 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-696b08ad-df82-4036-b931-fb59b6c8c706 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:21.410298 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-696b08ad-df82-4036-b931-fb59b6c8c706 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:21.411853 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-696b08ad-df82-4036-b931-fb59b6c8c706 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:21.413273 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-696b08ad-df82-4036-b931-fb59b6c8c706 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:21.624197 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-251e7b44-6287-4356-bd68-e3146ab94ea2 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:21.629514 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-696b08ad-df82-4036-b931-fb59b6c8c706 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:21.641978 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-251e7b44-6287-4356-bd68-e3146ab94ea2 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.274868 Jun 03 13:36:21.644443 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-696b08ad-df82-4036-b931-fb59b6c8c706 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1513 microversion: 2.1 time: 0.248616 Jun 03 13:36:21.645153 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 653/1213] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:21 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:21.645683 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 561/1214] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:21 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:21.921719 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-eb238499-50d0-4138-ae87-94ced2dda0af req-1e59ae96-11d7-445d-9b15-5e38427e8e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1980447-8506-4fc9-a363-b193f15aa056", "name": "network-vif-deleted", "tag": "ed9d39e3-b1e3-4ea5-a6ee-02103614ba7c"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:36:21.930835 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-eb238499-50d0-4138-ae87-94ced2dda0af req-1e59ae96-11d7-445d-9b15-5e38427e8e3a service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:21.931415 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-eb238499-50d0-4138-ae87-94ced2dda0af req-1e59ae96-11d7-445d-9b15-5e38427e8e3a service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:21.944316 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-eb238499-50d0-4138-ae87-94ced2dda0af req-1e59ae96-11d7-445d-9b15-5e38427e8e3a service nova] Creating event network-vif-deleted:ed9d39e3-b1e3-4ea5-a6ee-02103614ba7c for instance c1980447-8506-4fc9-a363-b193f15aa056 on hv-cinder-80135 Jun 03 13:36:21.949739 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-eb238499-50d0-4138-ae87-94ced2dda0af req-1e59ae96-11d7-445d-9b15-5e38427e8e3a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 Jun 03 13:36:21.950939 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 654/1215] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:36:22.661733 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-791f2438-ed70-45b6-a63d-a23eeb089626 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:22.662347 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-47b89d42-f946-4bc4-b8cf-7e3f8fefee7c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:22.662722 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-791f2438-ed70-45b6-a63d-a23eeb089626 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:22.662956 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-47b89d42-f946-4bc4-b8cf-7e3f8fefee7c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:22.669044 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-791f2438-ed70-45b6-a63d-a23eeb089626 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:22.669512 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-791f2438-ed70-45b6-a63d-a23eeb089626 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:22.669642 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47b89d42-f946-4bc4-b8cf-7e3f8fefee7c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:22.669996 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47b89d42-f946-4bc4-b8cf-7e3f8fefee7c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:22.670261 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-791f2438-ed70-45b6-a63d-a23eeb089626 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:22.670696 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-791f2438-ed70-45b6-a63d-a23eeb089626 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:22.670820 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47b89d42-f946-4bc4-b8cf-7e3f8fefee7c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:22.671183 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-47b89d42-f946-4bc4-b8cf-7e3f8fefee7c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:22.701913 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-791f2438-ed70-45b6-a63d-a23eeb089626 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:22.702358 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-791f2438-ed70-45b6-a63d-a23eeb089626 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:22.702805 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.objects.instance [None req-791f2438-ed70-45b6-a63d-a23eeb089626 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lazy-loading 'fault' on Instance uuid c1980447-8506-4fc9-a363-b193f15aa056 {{(pid=118178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:36:22.743801 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-791f2438-ed70-45b6-a63d-a23eeb089626 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:22.751360 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-791f2438-ed70-45b6-a63d-a23eeb089626 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 200 len: 1308 microversion: 2.1 time: 0.093521 Jun 03 13:36:22.751924 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 562/1216] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:22 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:22.801342 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-47b89d42-f946-4bc4-b8cf-7e3f8fefee7c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:22.808814 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-47b89d42-f946-4bc4-b8cf-7e3f8fefee7c tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.150823 Jun 03 13:36:22.809420 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 655/1217] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:22 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:23.769431 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6218e984-7868-4226-a388-045616a2fd83 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:23.770035 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6218e984-7868-4226-a388-045616a2fd83 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: c1980447-8506-4fc9-a363-b193f15aa056] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:23.777073 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6218e984-7868-4226-a388-045616a2fd83 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:23.777628 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6218e984-7868-4226-a388-045616a2fd83 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:23.778406 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6218e984-7868-4226-a388-045616a2fd83 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:23.778846 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6218e984-7868-4226-a388-045616a2fd83 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:23.795064 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-6218e984-7868-4226-a388-045616a2fd83 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] HTTP exception thrown: Instance c1980447-8506-4fc9-a363-b193f15aa056 could not be found. Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6218e984-7868-4226-a388-045616a2fd83 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Request method failure captured: Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 HTTP/1.1 Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimg4MoQ1Wi0aBlppSm6g8NJd-MkS7PC0PeU6Vkv6w5TpivF7fXwtbWp15CspeP46tia63APAK2QWUN_AXTawI0fkZ-YtzuehXCuzXSCb_trf3A9T8JJU1oDRjvsRXw9idpI2KgBkUdpothi7k_7rR1345bFTsQ6Xpduy9YiJ2KcrNW5w Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: bd537e9d76aa492dab87422257286816 Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-VolumesSnapshotTestJSON-358233036 Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:36:23.796689 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:36:23.802134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bd537e9d76aa492dab87422257286816"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd537e9d76aa492dab87422257286816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bd537e9d76aa492dab87422257286816", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd537e9d76aa492dab87422257286816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:36:23.802134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-VolumesSnapshotTestJSON-358233036 Jun 03 13:36:23.802134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: bd537e9d76aa492dab87422257286816 Jun 03 13:36:23.802134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-358233036 Jun 03 13:36:23.802134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-VolumesSnapshotTestJSON-358233036-project Jun 03 13:36:23.802134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:36:23.802134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:36:23.802134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: 3b71f0a1eb994da09f9a3336f2fe6eeb Jun 03 13:36:23.802134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-VolumesSnapshotTestJSON-358233036-project Jun 03 13:36:23.802134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:36:23.802134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance c1980447-8506-4fc9-a363-b193f15aa056 could not be found. Jun 03 13:36:23.802134 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': 'c1980447-8506-4fc9-a363-b193f15aa056'} Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1980447-8506-4fc9-a363-b193f15aa056 could not be found. Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:36:23.803274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1980447-8506-4fc9-a363-b193f15aa056 could not be found. Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1980447-8506-4fc9-a363-b193f15aa056 could not be found. Jun 03 13:36:23.804919 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:36:23.806193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6218e984-7868-4226-a388-045616a2fd83 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Returning 404 to user: Instance c1980447-8506-4fc9-a363-b193f15aa056 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:36:23.806193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6218e984-7868-4226-a388-045616a2fd83 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056" status: 404 len: 111 microversion: 2.1 time: 0.032620 Jun 03 13:36:23.806193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 563/1218] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:23 2022] GET /compute/v2.1/servers/c1980447-8506-4fc9-a363-b193f15aa056 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:36:23.825776 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-60338e8c-f0ee-43d8-873f-75d320c529d5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:23.826387 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-60338e8c-f0ee-43d8-873f-75d320c529d5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:23.832958 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-60338e8c-f0ee-43d8-873f-75d320c529d5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:23.833403 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-60338e8c-f0ee-43d8-873f-75d320c529d5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:23.834159 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-60338e8c-f0ee-43d8-873f-75d320c529d5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:23.834589 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-60338e8c-f0ee-43d8-873f-75d320c529d5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:23.967639 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-60338e8c-f0ee-43d8-873f-75d320c529d5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:23.975366 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-60338e8c-f0ee-43d8-873f-75d320c529d5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.153512 Jun 03 13:36:23.976125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 656/1219] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:23 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:24.994249 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-f3489218-2bdf-4c49-b60c-35342688db47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:24.995475 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-f3489218-2bdf-4c49-b60c-35342688db47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:25.002183 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f3489218-2bdf-4c49-b60c-35342688db47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:25.002626 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f3489218-2bdf-4c49-b60c-35342688db47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:25.003381 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f3489218-2bdf-4c49-b60c-35342688db47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:25.003811 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-f3489218-2bdf-4c49-b60c-35342688db47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:25.133111 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-f3489218-2bdf-4c49-b60c-35342688db47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:25.141241 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-f3489218-2bdf-4c49-b60c-35342688db47 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.150851 Jun 03 13:36:25.141799 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 564/1220] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:24 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:26.158188 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-84807055-edf4-4a04-a1ba-dfaeed13d046 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:26.158711 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-84807055-edf4-4a04-a1ba-dfaeed13d046 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:26.165319 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-84807055-edf4-4a04-a1ba-dfaeed13d046 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:26.165761 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-84807055-edf4-4a04-a1ba-dfaeed13d046 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:26.166588 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-84807055-edf4-4a04-a1ba-dfaeed13d046 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:26.167097 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-84807055-edf4-4a04-a1ba-dfaeed13d046 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:26.299335 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-84807055-edf4-4a04-a1ba-dfaeed13d046 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:26.306807 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-84807055-edf4-4a04-a1ba-dfaeed13d046 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.152572 Jun 03 13:36:26.307954 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 657/1221] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:26 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:27.325375 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-fb02be67-638c-469f-9b03-8803f15f6cd5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:27.325921 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-fb02be67-638c-469f-9b03-8803f15f6cd5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:27.332450 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fb02be67-638c-469f-9b03-8803f15f6cd5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:27.332897 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fb02be67-638c-469f-9b03-8803f15f6cd5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:27.333660 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fb02be67-638c-469f-9b03-8803f15f6cd5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:27.334094 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fb02be67-638c-469f-9b03-8803f15f6cd5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:27.468437 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-fb02be67-638c-469f-9b03-8803f15f6cd5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:27.475871 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-fb02be67-638c-469f-9b03-8803f15f6cd5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.155139 Jun 03 13:36:27.476474 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 565/1222] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:27 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:36:28.492757 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c20a2f27-900a-457e-bead-b7fadc284d95 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:28.493347 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c20a2f27-900a-457e-bead-b7fadc284d95 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:28.501549 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c20a2f27-900a-457e-bead-b7fadc284d95 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:28.507896 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c20a2f27-900a-457e-bead-b7fadc284d95 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:28.507896 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c20a2f27-900a-457e-bead-b7fadc284d95 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:28.507896 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c20a2f27-900a-457e-bead-b7fadc284d95 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:28.526374 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:28.639297 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c20a2f27-900a-457e-bead-b7fadc284d95 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:28.646689 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c20a2f27-900a-457e-bead-b7fadc284d95 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.157736 Jun 03 13:36:28.647250 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 658/1223] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:28 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:29.663724 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-08f20e75-cea8-4a55-b37c-2cea1176fae0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:29.664396 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-08f20e75-cea8-4a55-b37c-2cea1176fae0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:29.671485 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-08f20e75-cea8-4a55-b37c-2cea1176fae0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:29.671940 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-08f20e75-cea8-4a55-b37c-2cea1176fae0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:29.672921 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-08f20e75-cea8-4a55-b37c-2cea1176fae0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:29.673358 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-08f20e75-cea8-4a55-b37c-2cea1176fae0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:29.805447 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-08f20e75-cea8-4a55-b37c-2cea1176fae0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:29.813416 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-08f20e75-cea8-4a55-b37c-2cea1176fae0 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.153627 Jun 03 13:36:29.813980 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 566/1224] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:29 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:30.831424 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-fc2671cf-6ce0-4f16-b4d8-22f36aa286eb tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:30.836953 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-fc2671cf-6ce0-4f16-b4d8-22f36aa286eb tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:30.839176 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fc2671cf-6ce0-4f16-b4d8-22f36aa286eb tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:30.839736 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fc2671cf-6ce0-4f16-b4d8-22f36aa286eb tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:30.840399 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fc2671cf-6ce0-4f16-b4d8-22f36aa286eb tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:30.840836 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-fc2671cf-6ce0-4f16-b4d8-22f36aa286eb tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:30.971901 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-fc2671cf-6ce0-4f16-b4d8-22f36aa286eb tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:30.980342 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-fc2671cf-6ce0-4f16-b4d8-22f36aa286eb tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.152866 Jun 03 13:36:30.980915 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 659/1225] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:30 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:31.997369 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4ffb1394-c49f-4365-a1fd-7a0b1cf56455 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:31.998017 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4ffb1394-c49f-4365-a1fd-7a0b1cf56455 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:32.004682 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ffb1394-c49f-4365-a1fd-7a0b1cf56455 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:32.005124 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ffb1394-c49f-4365-a1fd-7a0b1cf56455 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:32.005882 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ffb1394-c49f-4365-a1fd-7a0b1cf56455 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:32.006309 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4ffb1394-c49f-4365-a1fd-7a0b1cf56455 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:32.139661 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4ffb1394-c49f-4365-a1fd-7a0b1cf56455 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:32.147077 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4ffb1394-c49f-4365-a1fd-7a0b1cf56455 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.154267 Jun 03 13:36:32.147633 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 567/1226] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:31 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:33.164765 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-5690be61-e2cc-481f-860f-7429942fe0f3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:33.165377 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-5690be61-e2cc-481f-860f-7429942fe0f3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:33.172667 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5690be61-e2cc-481f-860f-7429942fe0f3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:33.173117 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5690be61-e2cc-481f-860f-7429942fe0f3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:33.173872 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5690be61-e2cc-481f-860f-7429942fe0f3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:33.174306 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-5690be61-e2cc-481f-860f-7429942fe0f3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:33.304023 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-5690be61-e2cc-481f-860f-7429942fe0f3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:33.311592 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-5690be61-e2cc-481f-860f-7429942fe0f3 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.150684 Jun 03 13:36:33.312177 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 660/1227] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:33 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:34.142050 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1141966284", "imageRef": "87099552-fb27-43cc-9f91-9688eec3b9f3", "flavorRef": "452", "networks": [{"uuid": "fa807772-ecd4-41bb-8519-a68ce1a9c8a3"}]}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:36:34.192650 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.network.neutron [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] validate_networks() for [('fa807772-ecd4-41bb-8519-a68ce1a9c8a3', None, None, None, None, None)] {{(pid=118178) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:36:34.328438 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c9562c6b-7f8b-49cb-a8cf-14ade4c347dd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:34.329048 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c9562c6b-7f8b-49cb-a8cf-14ade4c347dd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:34.335452 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9562c6b-7f8b-49cb-a8cf-14ade4c347dd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:34.335900 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9562c6b-7f8b-49cb-a8cf-14ade4c347dd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:34.336707 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9562c6b-7f8b-49cb-a8cf-14ade4c347dd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:34.337141 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c9562c6b-7f8b-49cb-a8cf-14ade4c347dd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:34.469474 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c9562c6b-7f8b-49cb-a8cf-14ade4c347dd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:34.477043 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c9562c6b-7f8b-49cb-a8cf-14ade4c347dd tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.152496 Jun 03 13:36:34.477598 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 661/1228] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:34 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:34.532696 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Flavor limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:36:34.533117 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Image limits 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:36:34.533594 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Flavor pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:36:34.534011 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Image pref 0:0:0 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:36:34.534424 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.virt.hardware [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:36:34.543146 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:34.543767 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:34.544614 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:34.545058 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:34.562748 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Getting quotas for project bd537e9d76aa492dab87422257286816. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:36:34.566746 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.quota [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Getting quotas for user 3b71f0a1eb994da09f9a3336f2fe6eeb and project bd537e9d76aa492dab87422257286816. Resources: {'ram', 'cores', 'instances'} {{(pid=118178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:36:34.578193 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Going to run 1 instances... {{(pid=118178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:36:34.580435 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87099552-fb27-43cc-9f91-9688eec3b9f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:36:34.708640 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-a3fedbf4-73e8-4464-8fd0-5d1ce65c58e8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570682 Jun 03 13:36:34.709243 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 568/1229] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 13:36:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:36:34.719035 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c4a8f781-4728-43bb-a259-ba26a690623d tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:34.719654 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c4a8f781-4728-43bb-a259-ba26a690623d tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:34.775139 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-c4a8f781-4728-43bb-a259-ba26a690623d tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:34.781875 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c4a8f781-4728-43bb-a259-ba26a690623d tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1219 microversion: 2.1 time: 0.066714 Jun 03 13:36:34.782442 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 662/1230] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:34 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:35.494428 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-4b5c25e5-1862-483d-b9b5-64eaaf63ae4e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:35.495033 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-4b5c25e5-1862-483d-b9b5-64eaaf63ae4e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:35.502106 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4b5c25e5-1862-483d-b9b5-64eaaf63ae4e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:35.502552 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4b5c25e5-1862-483d-b9b5-64eaaf63ae4e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:35.503313 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4b5c25e5-1862-483d-b9b5-64eaaf63ae4e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:35.503747 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-4b5c25e5-1862-483d-b9b5-64eaaf63ae4e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:35.641730 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-4b5c25e5-1862-483d-b9b5-64eaaf63ae4e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:35.645145 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=100 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:35.649588 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-4b5c25e5-1862-483d-b9b5-64eaaf63ae4e tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.159578 Jun 03 13:36:35.650099 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 569/1231] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:35 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:35.798937 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-d642d4c5-341f-4154-b124-d546f09bd4f9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:35.799553 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-d642d4c5-341f-4154-b124-d546f09bd4f9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:35.807217 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d642d4c5-341f-4154-b124-d546f09bd4f9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:35.807640 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d642d4c5-341f-4154-b124-d546f09bd4f9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:35.809079 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d642d4c5-341f-4154-b124-d546f09bd4f9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:35.809619 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-d642d4c5-341f-4154-b124-d546f09bd4f9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:35.870219 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-d642d4c5-341f-4154-b124-d546f09bd4f9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:35.878682 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-d642d4c5-341f-4154-b124-d546f09bd4f9 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1215 microversion: 2.1 time: 0.083589 Jun 03 13:36:35.879337 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 663/1232] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:35 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:36.088586 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-2dc13328-d21a-491d-9f7f-84def175b804 req-2b818bdf-10c1-41d9-b92b-d0461614aa2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e599e23-8550-45f3-aa57-3a875f922883", "name": "network-vif-plugged", "status": "completed", "tag": "14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:36:36.097619 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-2dc13328-d21a-491d-9f7f-84def175b804 req-2b818bdf-10c1-41d9-b92b-d0461614aa2c service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:36.100101 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-2dc13328-d21a-491d-9f7f-84def175b804 req-2b818bdf-10c1-41d9-b92b-d0461614aa2c service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:36.111915 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-2dc13328-d21a-491d-9f7f-84def175b804 req-2b818bdf-10c1-41d9-b92b-d0461614aa2c service nova] Creating event network-vif-plugged:14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c for instance 5e599e23-8550-45f3-aa57-3a875f922883 on hv-cinder-80135 Jun 03 13:36:36.117035 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-2dc13328-d21a-491d-9f7f-84def175b804 req-2b818bdf-10c1-41d9-b92b-d0461614aa2c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032593 Jun 03 13:36:36.119065 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 570/1233] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:36:36.666892 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-aae1002a-fc8b-4d63-9c7e-660bfead1826 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:36.667532 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-aae1002a-fc8b-4d63-9c7e-660bfead1826 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:36.674085 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aae1002a-fc8b-4d63-9c7e-660bfead1826 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:36.674559 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aae1002a-fc8b-4d63-9c7e-660bfead1826 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:36.675318 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aae1002a-fc8b-4d63-9c7e-660bfead1826 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:36.675767 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-aae1002a-fc8b-4d63-9c7e-660bfead1826 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:36.810974 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-aae1002a-fc8b-4d63-9c7e-660bfead1826 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:36.819053 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-aae1002a-fc8b-4d63-9c7e-660bfead1826 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.156045 Jun 03 13:36:36.822802 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 664/1234] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:36 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:36.897311 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-94a124e4-780d-4a9e-9f2e-19e06c39875c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:36.898746 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-94a124e4-780d-4a9e-9f2e-19e06c39875c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:36.904615 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94a124e4-780d-4a9e-9f2e-19e06c39875c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:36.905122 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94a124e4-780d-4a9e-9f2e-19e06c39875c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:36.905880 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94a124e4-780d-4a9e-9f2e-19e06c39875c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:36.906311 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-94a124e4-780d-4a9e-9f2e-19e06c39875c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:36.987235 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-94a124e4-780d-4a9e-9f2e-19e06c39875c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:37.006477 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-94a124e4-780d-4a9e-9f2e-19e06c39875c tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1289 microversion: 2.1 time: 0.113883 Jun 03 13:36:37.007162 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 571/1235] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:36 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:37.837092 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ff05b658-5bc0-44de-9efa-c8f8f4dcad84 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:37.837689 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ff05b658-5bc0-44de-9efa-c8f8f4dcad84 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:37.844779 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ff05b658-5bc0-44de-9efa-c8f8f4dcad84 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:37.845507 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ff05b658-5bc0-44de-9efa-c8f8f4dcad84 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:37.846274 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ff05b658-5bc0-44de-9efa-c8f8f4dcad84 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:37.846712 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ff05b658-5bc0-44de-9efa-c8f8f4dcad84 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:37.982030 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ff05b658-5bc0-44de-9efa-c8f8f4dcad84 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:37.990240 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ff05b658-5bc0-44de-9efa-c8f8f4dcad84 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1573 microversion: 2.1 time: 0.156740 Jun 03 13:36:37.990798 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 665/1236] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:37 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:36:38.024235 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-5efa0a64-c03f-4e7d-8a0d-f5db559c029a tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:38.024775 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-5efa0a64-c03f-4e7d-8a0d-f5db559c029a tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:38.032253 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5efa0a64-c03f-4e7d-8a0d-f5db559c029a tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:38.032701 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5efa0a64-c03f-4e7d-8a0d-f5db559c029a tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:38.033463 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5efa0a64-c03f-4e7d-8a0d-f5db559c029a tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:38.033896 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-5efa0a64-c03f-4e7d-8a0d-f5db559c029a tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:38.144622 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-825ab63f-9463-43ff-9963-eb97cbfd1d0b req-580b4cc2-de80-4b08-a3b5-43ba3999a84c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b77ce1d-b198-404c-b9ab-9da0823ea39f", "tag": "00fdb803-9e77-4444-a767-33f82c3ecfa8"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:36:38.156773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-825ab63f-9463-43ff-9963-eb97cbfd1d0b req-580b4cc2-de80-4b08-a3b5-43ba3999a84c service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:38.156773 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-825ab63f-9463-43ff-9963-eb97cbfd1d0b req-580b4cc2-de80-4b08-a3b5-43ba3999a84c service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:38.172510 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-825ab63f-9463-43ff-9963-eb97cbfd1d0b req-580b4cc2-de80-4b08-a3b5-43ba3999a84c service nova] Creating event network-changed:00fdb803-9e77-4444-a767-33f82c3ecfa8 for instance 1b77ce1d-b198-404c-b9ab-9da0823ea39f on hv-cinder-80135 Jun 03 13:36:38.185093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-825ab63f-9463-43ff-9963-eb97cbfd1d0b req-580b4cc2-de80-4b08-a3b5-43ba3999a84c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038661 Jun 03 13:36:38.185093 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 666/1237] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:36:38.224473 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-5efa0a64-c03f-4e7d-8a0d-f5db559c029a tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:38.232585 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-5efa0a64-c03f-4e7d-8a0d-f5db559c029a tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1319 microversion: 2.1 time: 0.212163 Jun 03 13:36:38.233166 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 572/1238] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:38 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:39.007509 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-1ec0e02e-870f-4eac-95ee-31da31f62166 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:39.008527 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-1ec0e02e-870f-4eac-95ee-31da31f62166 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:39.015580 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1ec0e02e-870f-4eac-95ee-31da31f62166 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:39.016024 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1ec0e02e-870f-4eac-95ee-31da31f62166 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:39.016808 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1ec0e02e-870f-4eac-95ee-31da31f62166 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:39.017241 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-1ec0e02e-870f-4eac-95ee-31da31f62166 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:39.148096 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-1ec0e02e-870f-4eac-95ee-31da31f62166 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:39.156174 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-1ec0e02e-870f-4eac-95ee-31da31f62166 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1560 microversion: 2.1 time: 0.152892 Jun 03 13:36:39.156806 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 667/1239] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:39 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:39.249494 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-fb4dd5ba-0786-474c-8522-46cb581023cb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:39.250102 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-fb4dd5ba-0786-474c-8522-46cb581023cb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:39.256597 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fb4dd5ba-0786-474c-8522-46cb581023cb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:39.256990 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fb4dd5ba-0786-474c-8522-46cb581023cb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:39.257751 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fb4dd5ba-0786-474c-8522-46cb581023cb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:39.258439 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-fb4dd5ba-0786-474c-8522-46cb581023cb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:39.388446 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-fb4dd5ba-0786-474c-8522-46cb581023cb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:39.395801 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-fb4dd5ba-0786-474c-8522-46cb581023cb tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1319 microversion: 2.1 time: 0.150253 Jun 03 13:36:39.396391 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 573/1240] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:39 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:40.411959 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-06dc028a-2dc5-486d-9606-157cc5114df5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:40.412688 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-06dc028a-2dc5-486d-9606-157cc5114df5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:40.419107 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-06dc028a-2dc5-486d-9606-157cc5114df5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:40.419551 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-06dc028a-2dc5-486d-9606-157cc5114df5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:40.420342 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-06dc028a-2dc5-486d-9606-157cc5114df5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:40.420779 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-06dc028a-2dc5-486d-9606-157cc5114df5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:40.548160 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-06dc028a-2dc5-486d-9606-157cc5114df5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:40.555531 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-06dc028a-2dc5-486d-9606-157cc5114df5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1319 microversion: 2.1 time: 0.147465 Jun 03 13:36:40.556092 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 668/1241] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:40 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:41.572875 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-3af9351b-b93c-4f41-9f67-7cd4086af6d4 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:41.573482 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-3af9351b-b93c-4f41-9f67-7cd4086af6d4 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:41.580063 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3af9351b-b93c-4f41-9f67-7cd4086af6d4 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:41.580536 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3af9351b-b93c-4f41-9f67-7cd4086af6d4 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:41.581288 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3af9351b-b93c-4f41-9f67-7cd4086af6d4 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:41.581757 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-3af9351b-b93c-4f41-9f67-7cd4086af6d4 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:41.710436 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-3af9351b-b93c-4f41-9f67-7cd4086af6d4 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:41.718781 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-3af9351b-b93c-4f41-9f67-7cd4086af6d4 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1319 microversion: 2.1 time: 0.149756 Jun 03 13:36:41.722368 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 574/1242] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:41 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:42.734743 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-9b019cf4-986f-4f37-9ca7-de1b73f13c77 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:42.735346 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-9b019cf4-986f-4f37-9ca7-de1b73f13c77 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:42.737804 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:42.742441 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9b019cf4-986f-4f37-9ca7-de1b73f13c77 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:42.742884 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9b019cf4-986f-4f37-9ca7-de1b73f13c77 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:42.743630 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9b019cf4-986f-4f37-9ca7-de1b73f13c77 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:42.744060 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-9b019cf4-986f-4f37-9ca7-de1b73f13c77 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:42.874597 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-9b019cf4-986f-4f37-9ca7-de1b73f13c77 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:42.882085 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-9b019cf4-986f-4f37-9ca7-de1b73f13c77 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1319 microversion: 2.1 time: 0.151142 Jun 03 13:36:42.882649 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 669/1243] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:42 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:43.898746 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-77457bab-aba9-478c-baca-7cf86bbe2e9d tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:43.899400 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-77457bab-aba9-478c-baca-7cf86bbe2e9d tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:43.901864 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:43.907557 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-77457bab-aba9-478c-baca-7cf86bbe2e9d tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:43.908009 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-77457bab-aba9-478c-baca-7cf86bbe2e9d tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:43.908805 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-77457bab-aba9-478c-baca-7cf86bbe2e9d tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:43.909274 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-77457bab-aba9-478c-baca-7cf86bbe2e9d tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:44.043186 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-77457bab-aba9-478c-baca-7cf86bbe2e9d tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:44.051633 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-77457bab-aba9-478c-baca-7cf86bbe2e9d tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1319 microversion: 2.1 time: 0.156788 Jun 03 13:36:44.052203 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 575/1244] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:43 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:44.167884 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-4854a20a-9ba5-40ce-b552-22d0200d3fea req-41af9895-7788-4324-8c87-ae0e253651dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b77ce1d-b198-404c-b9ab-9da0823ea39f", "name": "network-vif-plugged", "status": "completed", "tag": "00fdb803-9e77-4444-a767-33f82c3ecfa8"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:36:44.177448 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-4854a20a-9ba5-40ce-b552-22d0200d3fea req-41af9895-7788-4324-8c87-ae0e253651dc service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:44.177899 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-4854a20a-9ba5-40ce-b552-22d0200d3fea req-41af9895-7788-4324-8c87-ae0e253651dc service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:44.188995 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-4854a20a-9ba5-40ce-b552-22d0200d3fea req-41af9895-7788-4324-8c87-ae0e253651dc service nova] Creating event network-vif-plugged:00fdb803-9e77-4444-a767-33f82c3ecfa8 for instance 1b77ce1d-b198-404c-b9ab-9da0823ea39f on hv-cinder-80135 Jun 03 13:36:44.193943 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-4854a20a-9ba5-40ce-b552-22d0200d3fea req-41af9895-7788-4324-8c87-ae0e253651dc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029819 Jun 03 13:36:44.194523 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 670/1245] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:36:45.069223 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-989f1b46-ffa8-400d-9288-35dc22b4ffdd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:45.069857 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-989f1b46-ffa8-400d-9288-35dc22b4ffdd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:45.071956 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=2 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:45.072702 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell0:SELECT=6 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:45.078848 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-989f1b46-ffa8-400d-9288-35dc22b4ffdd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:45.080563 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-989f1b46-ffa8-400d-9288-35dc22b4ffdd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:45.080563 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-989f1b46-ffa8-400d-9288-35dc22b4ffdd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:45.081154 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-989f1b46-ffa8-400d-9288-35dc22b4ffdd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:45.230126 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-989f1b46-ffa8-400d-9288-35dc22b4ffdd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:45.239824 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-989f1b46-ffa8-400d-9288-35dc22b4ffdd tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1319 microversion: 2.1 time: 0.175175 Jun 03 13:36:45.240713 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 576/1246] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:45 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:46.255470 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell0:SELECT=2 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:46.260323 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-3cdb6769-c692-4e3f-b98e-6e45d41990e0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:36:46.261019 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-3cdb6769-c692-4e3f-b98e-6e45d41990e0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:46.267873 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3cdb6769-c692-4e3f-b98e-6e45d41990e0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:46.268369 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3cdb6769-c692-4e3f-b98e-6e45d41990e0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:46.269129 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3cdb6769-c692-4e3f-b98e-6e45d41990e0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:46.269565 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-3cdb6769-c692-4e3f-b98e-6e45d41990e0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:46.400848 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-3cdb6769-c692-4e3f-b98e-6e45d41990e0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:36:46.408528 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-3cdb6769-c692-4e3f-b98e-6e45d41990e0 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1508 microversion: 2.1 time: 0.153970 Jun 03 13:36:46.409105 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 671/1247] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:36:46 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:36:46.424920 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-cb058b46-09c7-4228-9a29-edc40d542ba8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8204991-de92-4bbf-b138-596b35409362", "device": "/dev/sdb"}} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:36:46.426008 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-cb058b46-09c7-4228-9a29-edc40d542ba8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:36:46.432426 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cb058b46-09c7-4228-9a29-edc40d542ba8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:46.432871 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cb058b46-09c7-4228-9a29-edc40d542ba8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:46.433631 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cb058b46-09c7-4228-9a29-edc40d542ba8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:36:46.434075 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-cb058b46-09c7-4228-9a29-edc40d542ba8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:36:47.048981 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-cb058b46-09c7-4228-9a29-edc40d542ba8 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "POST /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627854 Jun 03 13:36:47.049618 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 577/1248] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 13:36:46 2022] POST /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f/os-volume_attachments => generated 194 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:37:09.965355 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-6a2538ec-e615-4dc4-8e81-a283671c5f9f tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:37:09.965881 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-6a2538ec-e615-4dc4-8e81-a283671c5f9f tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:37:09.967846 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=5 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:37:09.968567 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=66 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:37:09.973342 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6a2538ec-e615-4dc4-8e81-a283671c5f9f tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:09.979557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6a2538ec-e615-4dc4-8e81-a283671c5f9f tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:09.979557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6a2538ec-e615-4dc4-8e81-a283671c5f9f tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:09.979557 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-6a2538ec-e615-4dc4-8e81-a283671c5f9f tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:10.055561 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-6a2538ec-e615-4dc4-8e81-a283671c5f9f tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lazy-loading 'services' on Instance uuid 1b77ce1d-b198-404c-b9ab-9da0823ea39f {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:37:10.191719 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-6a2538ec-e615-4dc4-8e81-a283671c5f9f tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f/os-volume_attachments/f8204991-de92-4bbf-b138-596b35409362" status: 202 len: 0 microversion: 2.1 time: 0.230210 Jun 03 13:37:10.192444 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 672/1249] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 13:37:09 2022] DELETE /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f/os-volume_attachments/f8204991-de92-4bbf-b138-596b35409362 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:37:11.300875 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-aa405323-eecb-4749-8ecc-75e8fade3869 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:37:11.301484 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-aa405323-eecb-4749-8ecc-75e8fade3869 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:37:11.304130 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=5 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:37:11.304823 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:37:11.309815 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-aa405323-eecb-4749-8ecc-75e8fade3869 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:11.310302 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-aa405323-eecb-4749-8ecc-75e8fade3869 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:11.311063 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-aa405323-eecb-4749-8ecc-75e8fade3869 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:11.311495 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-aa405323-eecb-4749-8ecc-75e8fade3869 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:11.339115 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-aa405323-eecb-4749-8ecc-75e8fade3869 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Going to try to terminate instance {{(pid=118178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:37:11.569174 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-aa405323-eecb-4749-8ecc-75e8fade3869 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 204 len: 0 microversion: 2.1 time: 0.272775 Jun 03 13:37:11.569796 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 578/1250] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:37:11 2022] DELETE /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:37:11.579997 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-ed834ec7-e781-400b-bdc3-0c4bf0084aa5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:37:11.581463 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-ed834ec7-e781-400b-bdc3-0c4bf0084aa5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:37:11.587066 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ed834ec7-e781-400b-bdc3-0c4bf0084aa5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:11.587516 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ed834ec7-e781-400b-bdc3-0c4bf0084aa5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:11.588316 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ed834ec7-e781-400b-bdc3-0c4bf0084aa5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:11.588823 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-ed834ec7-e781-400b-bdc3-0c4bf0084aa5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:11.719971 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-ed834ec7-e781-400b-bdc3-0c4bf0084aa5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:37:11.727492 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-ed834ec7-e781-400b-bdc3-0c4bf0084aa5 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1514 microversion: 2.1 time: 0.153183 Jun 03 13:37:11.728067 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 673/1251] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:37:11 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:37:12.745385 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-8792cda6-2600-40d5-85f5-f3f4a9c73418 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:37:12.746079 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-8792cda6-2600-40d5-85f5-f3f4a9c73418 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:37:12.753449 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8792cda6-2600-40d5-85f5-f3f4a9c73418 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:12.753898 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8792cda6-2600-40d5-85f5-f3f4a9c73418 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:12.754655 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8792cda6-2600-40d5-85f5-f3f4a9c73418 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:12.755088 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-8792cda6-2600-40d5-85f5-f3f4a9c73418 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:12.886472 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-8792cda6-2600-40d5-85f5-f3f4a9c73418 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:37:12.894076 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-8792cda6-2600-40d5-85f5-f3f4a9c73418 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1514 microversion: 2.1 time: 0.153251 Jun 03 13:37:12.894664 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 579/1252] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:37:12 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:37:13.911317 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-2f240ca1-176d-40e2-846d-d17da7fdaf1b tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:37:13.911967 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-2f240ca1-176d-40e2-846d-d17da7fdaf1b tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:37:13.918577 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2f240ca1-176d-40e2-846d-d17da7fdaf1b tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:13.919029 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2f240ca1-176d-40e2-846d-d17da7fdaf1b tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:13.919800 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2f240ca1-176d-40e2-846d-d17da7fdaf1b tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:13.920263 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-2f240ca1-176d-40e2-846d-d17da7fdaf1b tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:14.052252 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-2f240ca1-176d-40e2-846d-d17da7fdaf1b tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b71f0a1eb994da09f9a3336f2fe6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd537e9d76aa492dab87422257286816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:37:14.059749 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-2f240ca1-176d-40e2-846d-d17da7fdaf1b tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 200 len: 1514 microversion: 2.1 time: 0.152323 Jun 03 13:37:14.060345 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 674/1253] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:37:13 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:37:14.192024 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [req-ff8f1361-423d-41f4-acb5-1ba9f5fc514a req-61937774-cc0d-4781-bc41-52c670369678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b77ce1d-b198-404c-b9ab-9da0823ea39f", "name": "network-vif-deleted", "tag": "00fdb803-9e77-4444-a767-33f82c3ecfa8"}]} {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:37:14.200590 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-ff8f1361-423d-41f4-acb5-1ba9f5fc514a req-61937774-cc0d-4781-bc41-52c670369678 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:14.204788 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [req-ff8f1361-423d-41f4-acb5-1ba9f5fc514a req-61937774-cc0d-4781-bc41-52c670369678 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:14.213111 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.compute.server_external_events [req-ff8f1361-423d-41f4-acb5-1ba9f5fc514a req-61937774-cc0d-4781-bc41-52c670369678 service nova] Creating event network-vif-deleted:00fdb803-9e77-4444-a767-33f82c3ecfa8 for instance 1b77ce1d-b198-404c-b9ab-9da0823ea39f on hv-cinder-80135 Jun 03 13:37:14.217895 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [req-ff8f1361-423d-41f4-acb5-1ba9f5fc514a req-61937774-cc0d-4781-bc41-52c670369678 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029499 Jun 03 13:37:14.222031 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 580/1254] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:37:15.076350 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c3b7f169-ea85-4376-b309-83fc75801320 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:37:15.076918 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-c3b7f169-ea85-4376-b309-83fc75801320 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] [instance: 1b77ce1d-b198-404c-b9ab-9da0823ea39f] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:37:15.083398 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c3b7f169-ea85-4376-b309-83fc75801320 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:15.083852 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c3b7f169-ea85-4376-b309-83fc75801320 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:15.084635 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c3b7f169-ea85-4376-b309-83fc75801320 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:37:15.085081 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-c3b7f169-ea85-4376-b309-83fc75801320 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:37:15.098482 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.wsgi [None req-c3b7f169-ea85-4376-b309-83fc75801320 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] HTTP exception thrown: Instance 1b77ce1d-b198-404c-b9ab-9da0823ea39f could not be found. Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c3b7f169-ea85-4376-b309-83fc75801320 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Request method failure captured: Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: request: GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f HTTP/1.1 Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept: application/json Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Accept-Encoding: identity Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Connection: close Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Length: 0 Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Content-Type: application/json Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Host: 10.222.0.61 Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Openstack-System-Scope: None Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: User-Agent: python-urllib3/1.26.9 Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Auth-Token: gAAAAABimg4MoQ1Wi0aBlppSm6g8NJd-MkS7PC0PeU6Vkv6w5TpivF7fXwtbWp15CspeP46tia63APAK2QWUN_AXTawI0fkZ-YtzuehXCuzXSCb_trf3A9T8JJU1oDRjvsRXw9idpI2KgBkUdpothi7k_7rR1345bFTsQ6Xpduy9YiJ2KcrNW5w Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Id: None Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Domain-Name: None Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Identity-Status: Confirmed Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Is-Admin-Project: True Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Id: default Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Domain-Name: Default Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Id: bd537e9d76aa492dab87422257286816 Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Project-Name: tempest-VolumesSnapshotTestJSON-358233036 Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Role: reader,member Jun 03 13:37:15.100125 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Roles: reader,member Jun 03 13:37:15.101679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bd537e9d76aa492dab87422257286816"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd537e9d76aa492dab87422257286816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bd537e9d76aa492dab87422257286816", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd537e9d76aa492dab87422257286816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:37:15.101679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant: tempest-VolumesSnapshotTestJSON-358233036 Jun 03 13:37:15.101679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Id: bd537e9d76aa492dab87422257286816 Jun 03 13:37:15.101679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-358233036 Jun 03 13:37:15.101679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User: tempest-VolumesSnapshotTestJSON-358233036-project Jun 03 13:37:15.101679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Id: default Jun 03 13:37:15.101679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Domain-Name: Default Jun 03 13:37:15.101679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Id: 3b71f0a1eb994da09f9a3336f2fe6eeb Jun 03 13:37:15.101679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: X-User-Name: tempest-VolumesSnapshotTestJSON-358233036-project Jun 03 13:37:15.101679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: method: > Jun 03 13:37:15.101679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: exception: Instance 1b77ce1d-b198-404c-b9ab-9da0823ea39f could not be found. Jun 03 13:37:15.101679 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: action_args: {'id': '1b77ce1d-b198-404c-b9ab-9da0823ea39f'} Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b77ce1d-b198-404c-b9ab-9da0823ea39f could not be found. Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:37:15.102854 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b77ce1d-b198-404c-b9ab-9da0823ea39f could not be found. Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b77ce1d-b198-404c-b9ab-9da0823ea39f could not be found. Jun 03 13:37:15.104819 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR nova.api.openstack.wsgi Jun 03 13:37:15.106246 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-c3b7f169-ea85-4376-b309-83fc75801320 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] Returning 404 to user: Instance 1b77ce1d-b198-404c-b9ab-9da0823ea39f could not be found. {{(pid=118179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:37:15.106246 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-c3b7f169-ea85-4376-b309-83fc75801320 tempest-VolumesSnapshotTestJSON-358233036 tempest-VolumesSnapshotTestJSON-358233036-project] 10.222.0.61 "GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f" status: 404 len: 111 microversion: 2.1 time: 0.029212 Jun 03 13:37:15.106246 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 675/1255] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:37:15 2022] GET /compute/v2.1/servers/1b77ce1d-b198-404c-b9ab-9da0823ea39f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:38:28.193697 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:38:28.194634 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG dbcounter [-] [118178] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:38:28.198032 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR oslo.messaging._drivers.impl_rabbit [-] [51c2e5ae-3675-4040-ae2d-a5894254b00d] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 03 13:38:28.198818 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-6bb196b8-c397-49e3-a29f-5246369ebc2a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:38:28.199397 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6bb196b8-c397-49e3-a29f-5246369ebc2a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:38:28.201661 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-44cf525f-42ec-4571-ba5a-2244b2587282 req-98850a12-685e-404c-98ee-347f2064a255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e599e23-8550-45f3-aa57-3a875f922883", "tag": "14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:38:28.205618 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_api:SELECT=8 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:38:28.206218 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6bb196b8-c397-49e3-a29f-5246369ebc2a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:28.206445 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG dbcounter [-] [118179] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=118179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:38:28.206650 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6bb196b8-c397-49e3-a29f-5246369ebc2a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:28.207432 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6bb196b8-c397-49e3-a29f-5246369ebc2a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:28.207990 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-6bb196b8-c397-49e3-a29f-5246369ebc2a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:28.212063 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-44cf525f-42ec-4571-ba5a-2244b2587282 req-98850a12-685e-404c-98ee-347f2064a255 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:28.215689 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-44cf525f-42ec-4571-ba5a-2244b2587282 req-98850a12-685e-404c-98ee-347f2064a255 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:28.225892 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-44cf525f-42ec-4571-ba5a-2244b2587282 req-98850a12-685e-404c-98ee-347f2064a255 service nova] Creating event network-changed:14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c for instance 5e599e23-8550-45f3-aa57-3a875f922883 on hv-cinder-80135 Jun 03 13:38:28.231115 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-44cf525f-42ec-4571-ba5a-2244b2587282 req-98850a12-685e-404c-98ee-347f2064a255 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035025 Jun 03 13:38:28.231943 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 676/1256] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:38:28.239429 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-6bb196b8-c397-49e3-a29f-5246369ebc2a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Going to try to terminate instance {{(pid=118178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:38:28.538788 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-6bb196b8-c397-49e3-a29f-5246369ebc2a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 204 len: 0 microversion: 2.1 time: 0.347064 Jun 03 13:38:28.542575 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 581/1257] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 13:38:28 2022] DELETE /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:38:28.549594 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-e6c93a4b-a21c-47a3-9b83-4586af3ce069 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:38:28.550430 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-e6c93a4b-a21c-47a3-9b83-4586af3ce069 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:38:28.557404 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6c93a4b-a21c-47a3-9b83-4586af3ce069 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:28.557933 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6c93a4b-a21c-47a3-9b83-4586af3ce069 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:28.558794 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6c93a4b-a21c-47a3-9b83-4586af3ce069 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:28.559297 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-e6c93a4b-a21c-47a3-9b83-4586af3ce069 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:28.816747 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-e6c93a4b-a21c-47a3-9b83-4586af3ce069 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:38:28.824479 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-e6c93a4b-a21c-47a3-9b83-4586af3ce069 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.280264 Jun 03 13:38:28.825056 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 677/1258] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:38:28 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:38:29.842684 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-268c6d31-271b-4fe7-8f6a-5f4ec9d3e6b5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:38:29.843371 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-268c6d31-271b-4fe7-8f6a-5f4ec9d3e6b5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:38:29.850774 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-268c6d31-271b-4fe7-8f6a-5f4ec9d3e6b5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:29.851311 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-268c6d31-271b-4fe7-8f6a-5f4ec9d3e6b5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:29.852067 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-268c6d31-271b-4fe7-8f6a-5f4ec9d3e6b5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:29.852525 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-268c6d31-271b-4fe7-8f6a-5f4ec9d3e6b5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:30.040894 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-268c6d31-271b-4fe7-8f6a-5f4ec9d3e6b5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:38:30.048664 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-268c6d31-271b-4fe7-8f6a-5f4ec9d3e6b5 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1566 microversion: 2.1 time: 0.210685 Jun 03 13:38:30.049226 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 582/1259] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:38:29 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1566 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:38:30.890274 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO oslo.messaging._drivers.impl_rabbit [-] [51c2e5ae-3675-4040-ae2d-a5894254b00d] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 51522. Jun 03 13:38:30.937021 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [req-c1505496-b733-4339-bec2-1b87d9d2e9ad req-ea0b25b9-79e1-4369-811d-b771379d94a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e599e23-8550-45f3-aa57-3a875f922883", "name": "network-vif-deleted", "tag": "14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c"}]} {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:38:30.946086 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-c1505496-b733-4339-bec2-1b87d9d2e9ad req-ea0b25b9-79e1-4369-811d-b771379d94a8 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:30.946529 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [req-c1505496-b733-4339-bec2-1b87d9d2e9ad req-ea0b25b9-79e1-4369-811d-b771379d94a8 service nova] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:30.957724 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.compute.server_external_events [req-c1505496-b733-4339-bec2-1b87d9d2e9ad req-ea0b25b9-79e1-4369-811d-b771379d94a8 service nova] Creating event network-vif-deleted:14e6b9c3-0be3-43a2-91fb-8b1aaaabe49c for instance 5e599e23-8550-45f3-aa57-3a875f922883 on hv-cinder-80135 Jun 03 13:38:30.962787 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [req-c1505496-b733-4339-bec2-1b87d9d2e9ad req-ea0b25b9-79e1-4369-811d-b771379d94a8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087303 Jun 03 13:38:30.963405 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 678/1260] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 13:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:38:31.065795 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-69542fa3-38a6-437e-8a2c-253c854bc55a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:38:31.066327 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-69542fa3-38a6-437e-8a2c-253c854bc55a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:38:31.072910 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-69542fa3-38a6-437e-8a2c-253c854bc55a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:31.073352 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-69542fa3-38a6-437e-8a2c-253c854bc55a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:31.074100 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-69542fa3-38a6-437e-8a2c-253c854bc55a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:31.074527 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-69542fa3-38a6-437e-8a2c-253c854bc55a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:31.137562 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.policy [None req-69542fa3-38a6-437e-8a2c-253c854bc55a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:38:31.145466 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-69542fa3-38a6-437e-8a2c-253c854bc55a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1219 microversion: 2.1 time: 0.084420 Jun 03 13:38:31.146056 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 583/1261] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:38:31 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:38:32.163707 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-07d3b94b-4b60-4f72-b8ab-e3da4ee68c43 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:38:32.164370 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.compute.api [None req-07d3b94b-4b60-4f72-b8ab-e3da4ee68c43 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:38:32.170622 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-07d3b94b-4b60-4f72-b8ab-e3da4ee68c43 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:32.171111 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-07d3b94b-4b60-4f72-b8ab-e3da4ee68c43 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:32.171825 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-07d3b94b-4b60-4f72-b8ab-e3da4ee68c43 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:32.172299 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-07d3b94b-4b60-4f72-b8ab-e3da4ee68c43 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:32.202777 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-07d3b94b-4b60-4f72-b8ab-e3da4ee68c43 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:32.203261 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG oslo_concurrency.lockutils [None req-07d3b94b-4b60-4f72-b8ab-e3da4ee68c43 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:32.203782 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.objects.instance [None req-07d3b94b-4b60-4f72-b8ab-e3da4ee68c43 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lazy-loading 'fault' on Instance uuid 5e599e23-8550-45f3-aa57-3a875f922883 {{(pid=118179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:38:32.246380 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.policy [None req-07d3b94b-4b60-4f72-b8ab-e3da4ee68c43 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225191825c1d49c795151c7bedf35d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:38:32.256186 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-07d3b94b-4b60-4f72-b8ab-e3da4ee68c43 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 200 len: 1224 microversion: 2.1 time: 0.097229 Jun 03 13:38:32.256790 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 679/1262] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:38:32 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:38:33.273816 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1677dab4-edfc-42a9-9d76-e048d6991016 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '>' {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:38:33.274359 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.compute.api [None req-1677dab4-edfc-42a9-9d76-e048d6991016 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [instance: 5e599e23-8550-45f3-aa57-3a875f922883] Fetching instance by UUID {{(pid=118178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:38:33.280602 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1677dab4-edfc-42a9-9d76-e048d6991016 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:33.281070 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1677dab4-edfc-42a9-9d76-e048d6991016 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:33.282500 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1677dab4-edfc-42a9-9d76-e048d6991016 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:38:33.282993 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG oslo_concurrency.lockutils [None req-1677dab4-edfc-42a9-9d76-e048d6991016 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Lock "49069df2-a830-4b3d-8fbf-b69025d043f4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:38:33.296154 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.wsgi [None req-1677dab4-edfc-42a9-9d76-e048d6991016 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] HTTP exception thrown: Instance 5e599e23-8550-45f3-aa57-3a875f922883 could not be found. Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1677dab4-edfc-42a9-9d76-e048d6991016 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Request method failure captured: Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: request: GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 HTTP/1.1 Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept: application/json Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Accept-Encoding: identity Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Connection: close Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Length: 0 Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Content-Type: application/json Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Host: 10.222.0.61 Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Openstack-System-Scope: None Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: User-Agent: python-urllib3/1.26.9 Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Auth-Token: gAAAAABimg1FQhaoypM6vBl3ExNJWwzWfe_2kHU0Vf7KG9PF19oNrNrk3-YEa_8FmUw-C-kC_2glubotaSGL4mL3fCsIayipCelRDorCCY2LwReVMz2Zbh6C3iF4umAPmXPOCN_CFaCo1lRWHDUOewwZkm0tkS0ZyIXiNOn7AUl9zPQaOMID63c Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Id: None Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Domain-Name: None Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Identity-Status: Confirmed Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Is-Admin-Project: True Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Id: default Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Domain-Name: Default Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Id: 225191825c1d49c795151c7bedf35d97 Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Project-Name: tempest-TestShelveInstance-722693088 Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Role: reader,member Jun 03 13:38:33.298045 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Roles: reader,member Jun 03 13:38:33.299886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/225191825c1d49c795151c7bedf35d97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/225191825c1d49c795151c7bedf35d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_225191825c1d49c795151c7bedf35d97", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/225191825c1d49c795151c7bedf35d97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jun 03 13:38:33.299886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant: tempest-TestShelveInstance-722693088 Jun 03 13:38:33.299886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Id: 225191825c1d49c795151c7bedf35d97 Jun 03 13:38:33.299886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-Tenant-Name: tempest-TestShelveInstance-722693088 Jun 03 13:38:33.299886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User: tempest-TestShelveInstance-722693088-project Jun 03 13:38:33.299886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Id: default Jun 03 13:38:33.299886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Domain-Name: Default Jun 03 13:38:33.299886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Id: a7da9a3f3e5f4eb4b1a01d33dcdb4bf2 Jun 03 13:38:33.299886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: X-User-Name: tempest-TestShelveInstance-722693088-project Jun 03 13:38:33.299886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: method: > Jun 03 13:38:33.299886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: exception: Instance 5e599e23-8550-45f3-aa57-3a875f922883 could not be found. Jun 03 13:38:33.299886 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: action_args: {'id': '5e599e23-8550-45f3-aa57-3a875f922883'} Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: {{(pid=118178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e599e23-8550-45f3-aa57-3a875f922883 could not be found. Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:38:33.300902 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e599e23-8550-45f3-aa57-3a875f922883 could not be found. Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e599e23-8550-45f3-aa57-3a875f922883 could not be found. Jun 03 13:38:33.302666 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: ERROR nova.api.openstack.wsgi Jun 03 13:38:33.304267 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: DEBUG nova.api.openstack.wsgi [None req-1677dab4-edfc-42a9-9d76-e048d6991016 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Returning 404 to user: Instance 5e599e23-8550-45f3-aa57-3a875f922883 could not be found. {{(pid=118178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:38:33.304267 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO nova.api.openstack.requestlog [None req-1677dab4-edfc-42a9-9d76-e048d6991016 tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883" status: 404 len: 111 microversion: 2.1 time: 0.029652 Jun 03 13:38:33.304267 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: [pid: 118178|app: 0|req: 584/1263] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 13:38:33 2022] GET /compute/v2.1/servers/5e599e23-8550-45f3-aa57-3a875f922883 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:38:33.499071 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: DEBUG nova.api.openstack.wsgi [None req-12367bf2-a52e-43aa-9270-49f19d90ee4a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] Calling method '.version_select at 0x7f5bcdc42790>' {{(pid=118179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:38:33.503245 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: ERROR oslo.messaging._drivers.impl_rabbit [None req-12367bf2-a52e-43aa-9270-49f19d90ee4a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [39d39d1b-3c97-485e-9147-de2fb59064b9] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 03 13:38:34.512730 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO oslo.messaging._drivers.impl_rabbit [None req-12367bf2-a52e-43aa-9270-49f19d90ee4a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] [39d39d1b-3c97-485e-9147-de2fb59064b9] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 51534. Jun 03 13:38:34.593078 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO nova.api.openstack.requestlog [None req-12367bf2-a52e-43aa-9270-49f19d90ee4a tempest-TestShelveInstance-722693088 tempest-TestShelveInstance-722693088-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1608104788" status: 202 len: 0 microversion: 2.1 time: 1.097836 Jun 03 13:38:34.593664 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: [pid: 118179|app: 0|req: 680/1264] 10.222.0.61 () {58 vars in 1253 bytes} [Fri Jun 3 13:38:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1608104788 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:38:41.587176 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:38:41.587693 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Fri Jun 3 13:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:40:34.783096 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:40:34.783827 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Fri Jun 3 13:40:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:41:47.173319 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:41:47.173987 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Fri Jun 3 13:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:42:01.595854 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:42:01.596468 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Fri Jun 3 13:42:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:42:10.404336 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:42:10.404984 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Fri Jun 3 13:42:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:43:36.731065 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:43:36.732115 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Fri Jun 3 13:43:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:43:54.792343 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:43:54.792941 dv-cinder-801354-5-iscsi devstack@n-api.service[118178]: Fri Jun 3 13:43:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:44:03.087972 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:44:03.088485 dv-cinder-801354-5-iscsi devstack@n-api.service[118179]: Fri Jun 3 13:44:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!